M
marlin
@IST-DASLab
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
Apache-2.0 Commit 2 jaaren geleden ★ 1.152
Pijlers en weging
Waarom deze score
- Apache-2.0 (permissief)
- Laatste commit 753 dagen geleden
- Top 71% naar sterren in Developer Tools › Operating Systems and Kernels
Feiten
- Licentie
- Apache-2.0 (Permissief)
- Taal
- Python
- GitHub-sterren
- 1.152
- Laatste commit
- 2024-09-04 (2 jaaren geleden)
- Laatste release
- Onbekend
- OpenSSF Scorecard
- Nog niet gemeten
- Zelf hosten
- Niet vastgesteld
- Maintainer-locatie
- Onbekend
- Bron
- github-crawl
Alternatieven in Grote taalmodellen
01 88 02 87 03 84 04 80
D
Dify.ai
Build, test and deploy LLM applications.
L
Langfuse
LLM engineering platform for model tracing, prompt management, and application evaluation. Langfuse helps teams collaboratively debug, analyze, and iterate on their LLM applications such as chatbots or AI agents.
T
textgen
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
F
Firecrawl
The web data API to search, scrape, and interact at scale. 🔥