MASTER

Fine-Tuning & LoRA

Customize models with LoRA, QLoRA, Unsloth, and Axolotl - fine-tune 70B models on a single GPU. Part of the free Open Source AI Academy — every lesson below is open to everyone, no signup required.

2 lessons300 XP~28 min total100% free

// LESSONS IN THIS MODULE

  1. 01LoRA & QLoRA Explained15 min · 150 XP

    Parameter-Efficient Fine-Tuning (PEFT) Full fine-tuning updates all billions of parameters - requiring massive GPU clusters. PEFT freezes the base mod...

  2. 02Axolotl v0.18: Production-Scale MoE Fine-Tuning13 min · 150 XP

    Fine-Tuning Frontier MoE Models Cheaply Axolotl v0.18 (released July 2026) is built around one theme: making 4-bit expert LoRA on very large sparse Mi...

Explore the full Open Source AI Academy