Beschrijving
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Atlas-score
- Apache-2.0 (permissive)
- Last commit 0 days ago
- Released within the last 12 months
- Top 55% by stars in AI & ML::Large Language Models