vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Python
Stars
97.0k
Forks
24.9k
License
Apache-2.0
Open Issues
10436
Updated
13m ago
No README available
Related Projects
affaan-m/ECC
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
303.8k
JavaScript
NousResearch/hermes-agent
The agent that grows with you
263.6k
Python
firecrawl/firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
202.1k
TypeScript
Significant-Gravitas/AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
188.0k
Python
ollama/ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
187.1k
Go
f/prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
177.6k
MDX
Statistics
- Stars
- 97.0k
- Forks
- 24.9k
- Open Issues
- 10436
- Created
- Feb 09, 2023
- Updated
- Nov 15, 2026