BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

A concise summary has not been added yet.

What is BerriAI/litellm?

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

How much does BerriAI/litellm cost?

BerriAI/litellm uses a Open source pricing model. Check the official website for current plans.

What is BerriAI/litellm used for?

BerriAI/litellm is listed on TolsAI under: Open Source.

Where can I use BerriAI/litellm?

BerriAI/litellm is available on its official website, github.com.