llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

A concise summary has not been added yet.

What is llm-d/llm-d?

Achieve state of the art inference performance with modern accelerators on Kubernetes

What is llm-d/llm-d used for?

llm-d/llm-d is listed on TolsAI under: Open Source.

Where can I use llm-d/llm-d?

llm-d/llm-d is available on its official website, github.com.