Beschrijving
A high-throughput and memory-efficient inference and serving engine for LLMs
Atlas-score
- CNCF landscape project
- Apache-2.0 (permissive)
- Last commit 0 days ago
- Released within the last 12 months
- Top 1% by stars in AI & ML::Machine Learning Frameworks