llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

A concise summary has not been added yet.

What is llm-d/llm-d?

Achieve state of the art inference performance with modern accelerators on Kubernetes

How much does llm-d/llm-d cost?

llm-d/llm-d uses a Open source pricing model. Check the official website for current plans.

What is llm-d/llm-d used for?

llm-d/llm-d is listed on TolsAI under: Open Source.

Where can I use llm-d/llm-d?

llm-d/llm-d is available on its official website, github.com.