Beschrijving
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Atlas-score
- Apache-2.0 (permissive)
- Last commit 0 days ago
- Released within the last 12 months
- Top 28% by stars in AI & ML::Machine Learning Frameworks
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer