Skip to content
Fossfits

Fine-tuning.

Train or adapt open models on your own GPU. LoRA, full fine-tunes, and tooling around datasets and recipes.

Sorted by Most popular

  1. nanoGPTKarpathy’s ~300-line GPT trainer — the cleanest way to learn LLM training.MIT · Linux, macOS, +163k
  2. LLaMA-FactoryWeb UI and YAML recipes for fine-tuning many open LLMs.Apache 2.0 · Linux, Windows, +158k
  3. UnslothFaster LoRA fine-tuning with lower VRAM on consumer GPUs.Apache 2.0 · Linux, Windows, +145k
  4. DeepSpeedMicrosoft’s Apache-2.0 ZeRO optimizer for multi-GPU, multi-node LLM training.Apache 2.0 · Linux, macOS, +243k
  5. pytorch-lightningPretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.Apache 2.0 · Linux31.3k
  6. PEFTHugging Face’s LoRA/QLoRA library that makes big-model tuning fit one GPU.Apache 2.0 · Linux, macOS, +122k
  7. TRLHugging Face’s Apache-2.0 trainers for SFT, DPO, PPO, and reward modeling.Apache 2.0 · Linux, macOS, +119k
  8. deeplearning4jSuite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...Apache 2.0 · Linux14.3k
  9. litgpt20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.Apache 2.0 · Linux13.7k
  10. AxolotlYAML-driven fine-tuning toolkit for serious training runs.Apache 2.0 · Linux, Docker11k
  11. torchtunePyTorch-native library for fine-tuning LLMs with recipes.BSD 3-Clause · Linux7k
  12. AIF360A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.Apache 2.0 · Linux2.9k
  13. titans-pytorchUnofficial implementation of Titans, SOTA memory for transformers, in PytorchMIT · Linux2k
  14. DI-starAn artificial intelligence platform for the StarCraft II with large-scale distributed training and grand-master agents.Apache 2.0 · Linux1.4k
  15. nfstreamNFStream: a Flexible Network Data Analysis Framework.LGPL-3.0 · Linux1.2k
  16. Prompt4ReasoningPapers[ACL 2023] Reasoning with Language Model Prompting: A SurveyMIT · Linux1k
  17. happy-transformerHappy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.Apache 2.0 · Linux546
  18. AIwaifuOpen-Waifu open-sourced finetunable customizable simpable AI waifu inspired by neuro-samaGPL-2.0 · Linux514
  19. dashAIdashAI: an interactive platform for training, evaluating and deploying AI modelsMIT · Linux460
  20. everything-ai-mlA curated collection of learning resources for Generative AI, Machine Learning, Agentic AI, LLMs, RAG, Fine-tuning, MLOps, and more.MIT · Linux460

1–20 of 27