CacheRoute
door AstraNetLab · open-source AI & ML · Grote taalmodellen
58/100
Beschrijving
CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency.
Atlas-score
- Apache-2.0 (permissive)
- Last commit 47 days ago
- Released within the last 12 months
- Top 63% by stars in Transport & Fleet::Route Optimization