🧰
Open Source Toolkit

Know how to use it before you click: online, self-hosted, desktop, CLI

中文

vLLM

vllm-project/vllm
Library Not a standalone app — install it into your own project and call it from code.

A high-throughput and memory-efficient inference and serving engine for LLMs

Local LLMDeveloper
vLLM website screenshot
Stars
★ 92.4k
Language
Python
License
Apache-2.0
Last updated
2026-09-22
Category
AI tools
Section
General