llm-inference.
Listed 3Updated Sep 10, 2026
Sorted by Most popular
- litgpt20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.apache-2.0 · linux13.7k
- incognideExplore the unknown, build the future, own your data.mit · linux471
- matrixhubAn Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.apache-2.0 · linux, docker350