Xinference vs llamafile
Facts only. Adjust the shortlist without leaving this page.
| Field | X XinferenceServe LLMs, embeddings, and media models from one Apache-2.0 platform. | L llamafileSingle-file LLM runtime from Mozilla. Download, chmod, run. |
|---|---|---|
| Fit. | ||
| Platforms· | Linux, macOS, Windows, Docker | Linux, macOS, Windows |
| Docker· | Yes | No |
| Commercial | yes | yes |
| Catalog. | ||
| Category· | LLM infrastructure | Local AI |
| License | Apache 2.0 | Apache 2.0 |
| Language· | Python | C++ |
| Jobs· | model serving, OpenAI-compatible local API | single-file LLM, portable local model, offline AI |
| Activity. | ||
| Stars· | 9.6k | 23k |
| Last commit· | Sep 11, 2026 | Jul 16, 2026 |
| Last release· | — | Jun 20, 2026 |
| Links | ProjectGitHubGuide | ProjectGitHubGuide |