Skip to content

unslothai/notebooks

Repository files navigation

unsloth logo

📒 Fine-tuning Notebooks

Below are our notebooks for Google Colab categorized by model. You can view our Kaggle notebooks here.
Use our guided notebooks to prep data, train, evaluate, and save your model. View our main GitHub repo here.

Main Notebooks

ModelTypeNotebook Link
Gemma3N(4B)MultimodalOpen in Colab
Qwen3 (14B)ConversationalOpen In Colab
Qwen3-Base (4B)GRPOOpen In Colab
Gemma 3 (4B)ConversationalOpen In Colab
Llama 3.2 (3B)ConversationalOpen In Colab
Phi-4 (14B)ConversationalOpen In Colab
Llama 3.2 Vision (11B)VisionOpen In Colab
Llama 3.1 (8B)AlpacaOpen In Colab
Mistral v0.3 (7B)ConversationalOpen In Colab
DeepSeek-R1-0528-Qwen3 (8B)GRPOOpen In Colab
Llama 3.2 (3B) by MetaSynthetic DataOpen In Colab
Sesame-CSM (1B)TTSOpen In Colab

Text-to-Speech (TTS) Notebooks

ModelTypeNotebook Link
Sesame-CSMTTSOpen In Colab
Orpheus-TTSTTSOpen In Colab
Spark-TTSTTSOpen In Colab
Oute-TTSTTSOpen In Colab
Oute-TTSTTSOpen In Colab
Llasa TTS (1B)TTSOpen In Colab
Llasa TTS (3B)TTSOpen In Colab
Whisper-Large-V3STTOpen In Colab

Vision (Multimodal) Notebooks

ModelTypeNotebook Link
Llama 3.2 (11B)VisionOpen In Colab
Qwen2.5 VL (7B)VisionOpen In Colab
Pixtral (12B)VisionOpen In Colab

BERT Notebooks

ModelNotebook Link
ModernBERT-largeOpen In Colab

Specific use-case Notebooks

UsecaseModelNotebook Link
Text ClassificationLlama 3.1 (8B)Open In Colab
Tool CallingQwen2.5-Coder (1.5B)Open In Colab
Multiple DatasetsOpen In Colab
KTOQwen2.5-Instruct (1.5B)Open In Colab
Inference Chat UILLaMa 3.2 VisionOpen In Colab
ConversationalLLaMa 3.2 (1B and 3B)Open In Colab
ChatMLMistral (7B)Open In Colab
Text CompletionMistral (7B)Open In Colab

GRPO Notebooks

ModelTypeNotebook Link
(A100) gpt oss(20B)GRPOOpen In Colab
gpt oss(20B)GRPOOpen In Colab
gpt oss(20B)GRPOOpen In Colab
Phi 4(14B)GRPOOpen In Colab
Llama3.1(8B)GRPOOpen In Colab
Meta Synthetic Data Llama3.1(8B)GRPOOpen In Colab
Gemma3(1B)GRPOOpen In Colab
Qwen3(4B)GRPOOpen In Colab
Meta Synthetic Data Llama3 2(3B)GRPOOpen In Colab
Qwen2.5(3B)GRPOOpen In Colab
DeepSeek R1 0528 Qwen3(8B)GRPOOpen In Colab
Mistral v0.3(7B)GRPOOpen In Colab

BERT Notebooks

ModelTypeNotebook Link
ModernBERT(Large)ClassificationOpen In Colab

Deepseek Notebooks

ModelTypeNotebook Link
Deepseek OCR(3B)Fine TuningOpen In Colab
Deepseek OCR(3B)EvalOpen In Colab
Deepseek OCR(3B)EvaluationOpen In Colab

GPT-OSS Notebooks

ModelTypeNotebook Link
(A100) gpt oss(120B)Fine TuningOpen In Colab
(OpenEnv) gpt oss(20B)GRPO 2048Open In Colab
gpt oss(20B)Fine TuningOpen In Colab
gpt oss BNB(20B)InferenceOpen In Colab
gpt oss(20B)GRPO 2048Open In Colab
(DGX Spark) gpt oss(20B)GRPO 2048Open In Colab
gpt oss(20B)Fine TuningOpen In Colab
(OpenEnv) gpt oss BF16(20B)GRPO 2048Open In Colab
gpt oss BF16(20B)GRPO 2048Open In Colab
gpt oss MXFP4(20B)InferenceOpen In Colab

Gemma Notebooks

ModelTypeNotebook Link
(A100) Gemma3(27B)ConversationalOpen In Colab
CodeGemma(7B)ConversationalOpen In Colab
Gemma3(4B)ConversationalOpen In Colab
Gemma3N(2B)InferenceOpen In Colab
Gemma3N(4B)MultimodalOpen In Colab
Gemma3(4B)VisionOpen In Colab
Gemma3(270M)ConversationalOpen In Colab
Gemma3N(4B)AudioOpen In Colab
Gemma3(4B)Vision GRPOOpen In Colab
Gemma3N(4B)VisionOpen In Colab
Gemma2(2B)AlpacaOpen In Colab
Gemma2(9B)AlpacaOpen In Colab

Granite Notebooks

ModelTypeNotebook Link
Granite4.0(3B)ConversationalOpen In Colab
Granite4.0(350M)ConversationalOpen In Colab

Linear Attention Notebooks

ModelTypeNotebook Link
Liquid LFM2(1.2B)ConversationalOpen In Colab
Liquid LFM2ConversationalOpen In Colab
Falcon H1AlpacaOpen In Colab
Falcon H1(0.5B)AlpacaOpen In Colab

Llama Notebooks

ModelTypeNotebook Link
(A100) Llama3.3(70B)ConversationalOpen In Colab
Llama3.2(1B)FP8 GRPOOpen In Colab
Llama3.2(1B and 3B)ConversationalOpen In Colab
Llama3.2(11B)VisionOpen In Colab
Llama3.2(1B)RAFTOpen In Colab
Llama3.1(8B)InferenceOpen In Colab
Llama3.1(8B)AlpacaOpen In Colab
Llama3(8B)OllamaOpen In Colab
Llama3(8B)AlpacaOpen In Colab
Llama3(8B)ORPOOpen In Colab
Llama3(8B)ConversationalOpen In Colab
TinyLlama(1.1B)AlpacaOpen In Colab

Mistral Notebooks

ModelTypeNotebook Link
Magistral(24B)Reasoning ConversationalOpen In Colab
Mistral Small(22B)AlpacaOpen In Colab
Pixtral(12B)VisionOpen In Colab
Mistral Nemo(12B)AlpacaOpen In Colab
Zephyr(7B)DPOOpen In Colab
Mistral(7B)Text CompletionOpen In Colab
Ministral3 VL(3B)VisionOpen In Colab
Ministral3(3B)GRPO SudokuOpen In Colab
Mistral v0.3(7B)ConversationalOpen In Colab
Mistral v0.3(7B)CPTOpen In Colab
Mistral v0.3(7B)AlpacaOpen In Colab

Phi Notebooks

ModelTypeNotebook Link
Phi 4ConversationalOpen In Colab
Phi 3.5 MiniConversationalOpen In Colab
Phi 3 MediumConversationalOpen In Colab

Qwen Notebooks

ModelTypeNotebook Link
(A100) Qwen3(32B)Reasoning ConversationalOpen In Colab
Qwen3(4B)ConversationalOpen In Colab
Qwen3 VL(8B)Vision GRPOOpen In Colab
Qwen3(14B)Open In Colab
Qwen3(8B)FP8 GRPOOpen In Colab
Qwen3(14B)Reasoning ConversationalOpen In Colab
Qwen3(4B)ThinkingOpen In Colab
Qwen3 VL(8B)VisionOpen In Colab
Qwen3(4B)QATOpen In Colab
Qwen3(14B)AlpacaOpen In Colab
Qwen2.5 Coder(1.5B)Tool CallingOpen In Colab
Qwen2.5 VL(7B)VisionOpen In Colab
Qwen2.5 Coder(14B)ConversationalOpen In Colab
Qwen2.5 VL(7B)Vision GRPOOpen In Colab
Qwen2.5(7B)AlpacaOpen In Colab
Qwen2 VL(7B)VisionOpen In Colab
Qwen2(7B)AlpacaOpen In Colab

TTS Notebooks

ModelTypeNotebook Link
Orpheus(3B)TTSOpen In Colab
Llasa TTS(3B)TTSOpen In Colab
Sesame CSM(1B)TTSOpen In Colab
Llasa TTS(1B)TTSOpen In Colab
Oute TTS(1B)TTSOpen In Colab
Spark TTS(0.5B)TTSOpen In Colab

Whisper Notebooks

ModelTypeNotebook Link
Whisper(Large)Fine TuningOpen In Colab

Other Notebooks

ModelTypeNotebook Link
ERNIE 4 5 VL 28B A3B PTVisionOpen In Colab
ERNIE 4 5 21B A3B PTConversationalOpen In Colab
UnslothStudioOpen In Colab
CodeForces cot Finetune for Reasoning on CodeForcesReasoningOpen In Colab
Synthetic Data HackathonSynthetic DataOpen In Colab

📒 Kaggle Notebooks

Click for all our Kaggle notebooks categorized by model:

GRPO Notebooks

ModelTypeNotebook Link
(A100) gpt oss(20B)GRPOOpen in Kaggle
gpt oss(20B)GRPOOpen in Kaggle
gpt oss(20B)GRPOOpen in Kaggle
Phi 4(14B)GRPOOpen in Kaggle
Llama3.1(8B)GRPOOpen in Kaggle
Meta Synthetic Data Llama3.1(8B)GRPOOpen in Kaggle
Gemma3(1B)GRPOOpen in Kaggle
Meta Synthetic Data Llama3 2(3B)GRPOOpen in Kaggle
Qwen3(4B)GRPOOpen in Kaggle
Qwen2.5(3B)GRPOOpen in Kaggle
DeepSeek R1 0528 Qwen3(8B)GRPOOpen in Kaggle
Mistral v0.3(7B)GRPOOpen in Kaggle

BERT Notebooks

ModelTypeNotebook Link
ModernBERT(Large)ClassificationOpen in Kaggle

Deepseek Notebooks

ModelTypeNotebook Link
Deepseek OCR(3B)EvaluationOpen in Kaggle
Deepseek OCR(3B)EvalOpen in Kaggle
Deepseek OCR(3B)Fine TuningOpen in Kaggle

GPT-OSS Notebooks

ModelTypeNotebook Link
(A100) gpt oss(120B)Fine TuningOpen in Kaggle
gpt oss(20B)Fine TuningOpen in Kaggle
gpt oss(20B)Fine TuningOpen in Kaggle
gpt oss BNB(20B)InferenceOpen in Kaggle
gpt oss MXFP4(20B)InferenceOpen in Kaggle

Gemma Notebooks

ModelTypeNotebook Link
(A100) Gemma3(27B)ConversationalOpen in Kaggle
CodeGemma(7B)ConversationalOpen in Kaggle
Gemma3N(2B)InferenceOpen in Kaggle
Gemma3N(4B)VisionOpen in Kaggle
Gemma3(4B)VisionOpen in Kaggle
Gemma3(270M)ConversationalOpen in Kaggle
Gemma3(4B)ConversationalOpen in Kaggle
Gemma3N(4B)MultimodalOpen in Kaggle
Gemma3(4B)Vision GRPOOpen in Kaggle
Gemma3N(4B)AudioOpen in Kaggle
Gemma2(9B)AlpacaOpen in Kaggle
Gemma2(2B)AlpacaOpen in Kaggle

Granite Notebooks

ModelTypeNotebook Link
Granite4.0(3B)ConversationalOpen in Kaggle
Granite4.0(350M)ConversationalOpen in Kaggle

Linear Attention Notebooks

ModelTypeNotebook Link
Liquid LFM2(1.2B)ConversationalOpen in Kaggle
Falcon H1(0.5B)AlpacaOpen in Kaggle

Llama Notebooks

ModelTypeNotebook Link
(A100) Llama3.3(70B)ConversationalOpen in Kaggle
Llama3.2(11B)VisionOpen in Kaggle
Llama3.2(1B and 3B)ConversationalOpen in Kaggle
Llama3.2(1B)RAFTOpen in Kaggle
Llama3.2(1B)FP8 GRPOOpen in Kaggle
Llama3.1(8B)AlpacaOpen in Kaggle
Llama3.1(8B)InferenceOpen in Kaggle
Llama3(8B)AlpacaOpen in Kaggle
Llama3(8B)OllamaOpen in Kaggle
Llama3(8B)ConversationalOpen in Kaggle
Llama3(8B)ORPOOpen in Kaggle
TinyLlama(1.1B)AlpacaOpen in Kaggle

Mistral Notebooks

ModelTypeNotebook Link
Magistral(24B)Reasoning ConversationalOpen in Kaggle
Mistral Small(22B)AlpacaOpen in Kaggle
Pixtral(12B)VisionOpen in Kaggle
Mistral Nemo(12B)AlpacaOpen in Kaggle
Mistral(7B)Text CompletionOpen in Kaggle
Zephyr(7B)DPOOpen in Kaggle
Ministral3(3B)GRPO SudokuOpen in Kaggle
Ministral3 VL(3B)VisionOpen in Kaggle
Mistral v0.3(7B)ConversationalOpen in Kaggle
Mistral v0.3(7B)AlpacaOpen in Kaggle
Mistral v0.3(7B)CPTOpen in Kaggle

Phi Notebooks

ModelTypeNotebook Link
Phi 4ConversationalOpen in Kaggle
Phi 3.5 MiniConversationalOpen in Kaggle
Phi 3 MediumConversationalOpen in Kaggle

Qwen Notebooks

ModelTypeNotebook Link
(A100) Qwen3(32B)Reasoning ConversationalOpen in Kaggle
Qwen3(4B)ThinkingOpen in Kaggle
Qwen3 VL(8B)Vision GRPOOpen in Kaggle
Qwen3 VL(8B)VisionOpen in Kaggle
Qwen3(14B)Reasoning ConversationalOpen in Kaggle
Qwen3(14B)Open in Kaggle
Qwen3(14B)AlpacaOpen in Kaggle
Qwen3(4B)ConversationalOpen in Kaggle
Qwen3(4B)QATOpen in Kaggle
Qwen3(8B)FP8 GRPOOpen in Kaggle
Qwen2.5(7B)AlpacaOpen in Kaggle
Qwen2.5 Coder(14B)ConversationalOpen in Kaggle
Qwen2.5 Coder(1.5B)Tool CallingOpen in Kaggle
Qwen2.5 VL(7B)VisionOpen in Kaggle
Qwen2.5 VL(7B)Vision GRPOOpen in Kaggle
Qwen2 VL(7B)VisionOpen in Kaggle
Qwen2(7B)AlpacaOpen in Kaggle

TTS Notebooks

ModelTypeNotebook Link
Llasa TTS(3B)TTSOpen in Kaggle
Orpheus(3B)TTSOpen in Kaggle
Oute TTS(1B)TTSOpen in Kaggle
Llasa TTS(1B)TTSOpen in Kaggle
Sesame CSM(1B)TTSOpen in Kaggle
Spark TTS(0.5B)TTSOpen in Kaggle

Whisper Notebooks

ModelTypeNotebook Link
Whisper(Large)Fine TuningOpen in Kaggle

Other Notebooks

ModelTypeNotebook Link
ERNIE 4 5 VL 28B A3B PTVisionOpen in Kaggle
ERNIE 4 5 21B A3B PTConversationalOpen in Kaggle
CodeForces cot Finetune for Reasoning on CodeForcesReasoningOpen in Kaggle
UnslothStudioOpen in Kaggle

✨ Contributing to Notebooks

If you'd like to contribute to our notebooks, here's a guide to get you started:

  1. Find the Template: We've provided a template notebook called Template_Notebook.ipynb in the root directory of this project. This template contains the basic structure and formatting guidelines for all notebooks in this collection.
  2. Create Your Notebook:
    • Make a copy of Template_Notebook.ipynb.
    • Rename the copied file to follow this naming convention:
      • LLM Notebooks:<Model Name>-<Type>.ipynb (e.g., Mistral_v0.3_(7B)-Alpaca.ipynb)
      • Vision Notebooks:<Model Name>-Vision.ipynb (e.g., Llava_v1.6_(7B)-Vision.ipynb)
      • Example of <Type>:Alpaca, Conversational, CPT, DPO, ORPO, Text_Completion, CSV, Inference, Unsloth_Studio
  3. Place in original_template: Once your notebook is ready, move it to the original_template directory.
  4. Update Notebooks: Run the following command in your terminal:
    python update_all_notebooks.py
    This script will automatically:
    • Copy your notebook from original_template to the notebooks directory.
    • Update the notebook's internal sections (like Installation, News) to ensure consistency.
    • Add your notebook to the appropriate list in this README.md file.
  5. Create a Pull Request: After that, just create a pull request (PR) to merge your changes, making it available for everyone!
    • We appreciate your contributions and look forward to reviewing your notebooks!

About

100+ Fine-tuning Tutorial Notebooks on Google Colab, Kaggle and more.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published