gguf.
Listed 5Updated Sep 10, 2026
Sorted by Most popular
- OllamaLocal model runner with a one-line CLI and a REST API.mit · linux, macos, +2152k
- llama.cppC/C++ runtime that made local GGUF models practical.mit · linux, macos, +187k
- exoLink everyday devices into one cluster and run models too big for any single machine.apache-2.0 · linux, macos47k
- KoboldCppOne-file llama.cpp build with a built-in chat UI aimed at offline storytelling.agpl-3.0 · linux, macos, +112k
- PocketPal AIRun small GGUF chat models fully offline on iOS and Android.mit · ios, android8k