Skip to content
Fossfits

Local AI.

Run language models on a laptop or a home GPU. Chat, complete, and serve weights without sending prompts to a vendor.

Sorted by Most popular

  1. OllamaLocal model runner with a one-line CLI and a REST API.MIT · Linux, macOS, +2152k
  2. Open WebUISelf-hosted chat UI that sits on Ollama, OpenAI, or a local runner.BSD 3-Clause · Linux, macOS, +3111k
  3. llama.cppC/C++ runtime that made local GGUF models practical.MIT · Linux, macOS, +187k
  4. GPT4AllNomic’s local chat app and model catalog for laptops without a GPU.MIT · Linux, macOS, +176k
  5. exoLink everyday devices into one cluster and run models too big for any single machine.Apache 2.0 · Linux, macOS47k
  6. text-generation-webuiGradio UI for local models with loaders, LoRA, and extensions.AGPL-3.0 · Linux, Windows, +145k
  7. JanDesktop ChatGPT-style app that runs models locally.AGPL-3.0 · Linux, macOS, +138k
  8. LocalAIOpenAI-compatible API that can sit in front of several local backends.MIT · Linux, macOS, +235k
  9. MLXApple’s framework for running and training models on Mac unified memory.MIT · macOS28k
  10. llamafileSingle-file LLM runtime from Mozilla. Download, chmod, run.Apache 2.0 · Linux, macOS, +123k
  11. KoboldCppOne-file llama.cpp build with a built-in chat UI aimed at offline storytelling.AGPL-3.0 · Linux, macOS, +112k
  12. shell_gptCLI that runs an LLM as a shell command for scripts, refactors, and answers.MIT · Linux, macOS, +112k
  13. PocketPal AIRun small GGUF chat models fully offline on iOS and Android.MIT · iOS, Android8k
  14. opencommittop #1 and most feature rich GPT wrapper for git — generate commit messages with an LLM in 1 sec — works with Claude, GPT and every other provider, supports local Ollama models tooMIT · Linux7.5k
  15. WritingToolsThe world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works on Windows, Linux, & macOS, with the free Gemini API, local LLMs, & more.GPL-3.0 · Linux, macOS, +12.4k
  16. local-attentionAn implementation of local windowed attention for language modelingMIT · Linux505
  17. codinit-devLocal-First Open Source web & mobile AI app builder — install on MacOS, Windows & LinuxMIT · Linux, macOS, +1265