Fine tuning LLMs

Last updated Nov 14, 2024 Edit Source

• Maxime Labonne - A Beginner’s Guide to LLM Fine-Tuning
• Finetune LLMs on your own consumer hardware using tools from PyTorch and Hugging Face ecosystem | PyTorch
• Fine-Tuning - LlamaIndex
• Maxime Labonne - Fine-tune Mistral-7b with Direct Preference Optimization
• Maxime Labonne - Fine-tune Llama 3 with ORPO
• Maxime Labonne - Fine-tune Llama 3.1 Ultra-Efficiently with Unsloth
• PEFT:
  • Efficient Fine-tuning with PEFT and LoRA | Niklas Heidloff

• #CODE Axolotl
  • Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures
  • Axolotl
• #CODE Unsloth
• #CODE Torchtune

• #PAPER FineTuneBench: How well do commercial fine-tuning APIs infuse knowledge into LLMs?
  • FineTuneBench