Multihead attention: Comet.ml Comet.ml - Supercharging Machine Learning
GPT-2: https://huggingface.co/openai-community/gpt2
LM evaluation harness: https://github.com/EleutherAI/lm-evaluation-harness
axolotl: https://github.com/axolotl-ai-cloud/axolotl
fine-tune data formats: Dataset Formats – Axolotl
Memory calculation: https://llm-system-requirements.streamlit.app/
huggingface open-llm leaderboard: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard