TolsAI
Submit a toolLogin

Tool profile

Open Source

smg-project/smg

github.com

565 stars · updated 2026-10-11 · Rust

Visit websiteBack to launches
What it doesTagsFAQRelated tools
Monthly visitsN/A
Global rankN/A
PublishedOct 17, 2026
PricingUnknown pricing

What it does

smg-project/smg

github.com

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

PricingUnknown pricing
RatingN/A
Bookmarks0

Tags

Categories

Open Source

A concise summary has not been added yet.

githubopen-sourcellmclaudeanthropicgeminichatanthropic-apiinference-gatewaylightseek

FAQ

Frequently asked questions

What is smg-project/smg?
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
What is smg-project/smg used for?
smg-project/smg is listed on TolsAI under: Open Source.
Where can I use smg-project/smg?
smg-project/smg is available on its official website, github.com.

Explore

More in Open Source

mindsdb/antonOpen Source

755 stars · updated 2026-10-04 · Python

Not specifiedgithub
N/AMonthly visits
learnhouse/learnhouseOpen Source

2,317 stars · updated 2026-10-04 · Python

Not specifiedgithub
N/AMonthly visits
pykeio/ortOpen Source

2,569 stars · updated 2026-10-17 · Rust

Not specifiedgithub
N/AMonthly visits

Discussion

Discussion

No comments yet. Start the discussion.