Tool profile
vLLM
vllm.ai
High-throughput, memory-efficient inference and serving engine for LLMs.
What it does
vLLM
vLLM (Apache-2.0) is a widely used open-source engine for serving large language models with high throughput and memory efficiency, supporting models such as Llama, Qwen and DeepSeek on CUDA, AMD and TPU hardware.
PricingUnknown pricing
RatingN/A
Bookmarks0
Tags
Categories
A concise summary has not been added yet.
FAQ
Frequently asked questions
- What is vLLM?
- vLLM (Apache-2.0) is a widely used open-source engine for serving large language models with high throughput and memory efficiency, supporting models such as Llama, Qwen and DeepSeek on CUDA, AMD and TPU hardware.
- What is vLLM used for?
- vLLM is listed on TolsAI under: AI Developer Tools and Large Language Models (LLMs).
- Where can I use vLLM?
- vLLM is available on its official website, vllm.ai.
Explore
More in AI Developer Tools
you.bot: The same AI models for up to 46% less. you.bot is one API for 70+ LLM, image, video and music models — Claude, GPT, Gemini, Kling, Seedance, Veo, GPT Image 2, Nano Banana Pro, Suno and more —
Corrath: Corrath is an AI security gateway for modern AI applications. It sits between your app and AI providers to protect API keys, block prompt injections, control spending, monitor usage, detect t
Turn a codebase plus its docs, SQL schemas, configs and PDFs into a queryable knowledge graph for coding agents.
A coding-agent skill from Cloudflare for multi-phase security audits with verified, machine-readable findings.
Redis/Valkey-compatible in-memory database in Rust with built-in full-text and vector search.
A ruleset/skill that makes AI coding agents write the least code that works.
Discussion
Discussion
Log in to join the discussion
No comments yet. Start the discussion.