flash-cosine-sim-attention vs LiteLLM
Facts only. Adjust the shortlist without leaving this page.
| Field | F flash-cosine-sim-attentionImplementation of fused cosine similarity attention in the same style as Flash Attention | L LiteLLMProxy that translates many model APIs into one OpenAI-shaped client. |
|---|---|---|
| Fit. | ||
| Platforms· | Linux | Linux, macOS, Windows, Docker |
| Docker· | No | Yes |
| Commercial | yes | yes |
| Catalog. | ||
| Category | LLM infrastructure | LLM infrastructure |
| License | MIT | MIT |
| Language | Python | Python |
| Jobs· | llm infra, artificial intelligence, attention mechanisms | LLM gateway, multi-provider proxy |
| Activity. | ||
| Stars· | 221 | 30k |
| Last commit· | Aug 24, 2026 | Sep 6, 2026 |
| Last release· | — | Aug 29, 2026 |
| Links | ProjectGitHubGuide | ProjectGitHubGuide |