AI open-source project
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
- Stars
- 96,210
- 7d
- Collecting data
- 30d
- Collecting data
Star history (UTC)
- 96,210
Metrics without today’s or the matching baseline snapshot remain unavailable.