Tool profile
vllm-project/semantic-router
github.com
An open, programmable decision layer that routes each LLM call to the best model and compute backend.
What it does
vllm-project/semantic-router
vLLM Semantic Router gives agent harnesses a single API for many models, selecting or combining backends per call based on your policy for quality, latency, cost and location. It is aimed at teams running LLM agents across local, private and cloud compute who want consistent routing and guardrails. It is written in Go and offered as an installable open project with documentation and an online playground.
PricingOpen source
RatingN/A
Bookmarks0
Tags
Categories
A concise summary has not been added yet.
FAQ
Frequently asked questions
- What is vllm-project/semantic-router?
- vLLM Semantic Router gives agent harnesses a single API for many models, selecting or combining backends per call based on your policy for quality, latency, cost and location. It is aimed at teams running LLM agents across local, private and cloud compute who want consistent routing and guardrails. It is written in Go and offered as an installable open project with documentation and an online playground.
- How much does vllm-project/semantic-router cost?
- vllm-project/semantic-router uses a Open source pricing model. Check the official website for current plans.
- What is vllm-project/semantic-router used for?
- vllm-project/semantic-router is listed on TolsAI under: Open Source.
- Where can I use vllm-project/semantic-router?
- vllm-project/semantic-router is available on its official website, github.com.
Explore
More in Open Source
An open-source agentic harness for a self-improving AI agent that plans and executes tasks you describe.
A vectorless, reasoning-based RAG engine that indexes documents as trees and retrieves with LLM reasoning.
A PyTorch-like Python library to build and auto-optimize LLM workflows such as chatbots, RAG and agents.
A modular web UI for generating images, video and audio with AI models like Stable Diffusion, Flux and Wan.
A step-by-step guide to designing AI systems built on LLMs, RAG, and AI agents.
Open-source AI pipeline engine for building, debugging and deploying LLM workflows and agent orchestration from your IDE.
Discussion
Discussion
Log in to join the discussion
No comments yet. Start the discussion.