Beschrijving
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Atlas-score
- Apache-2.0 (permissive)
- Last commit 0 days ago
- Released within the last 12 months
- Top 22% by stars in AI & ML::Large Language Models