Tool profile
zhongkaifu/TensorSharp
github.com
A .NET inference engine and agent runtime for running local GGUF LLM models with GPU backends.
What it does
zhongkaifu/TensorSharp
TensorSharp is a .NET inference engine and agent runtime for local GGUF models, offering a CLI, browser chat, iPhone app and Ollama/OpenAI-compatible APIs. It supports text, multimodal input, embeddings, image and video generation, personal knowledge collections and agent skills, running on managed C# CPU kernels or native CUDA, Metal and Vulkan backends across Windows, macOS, iOS and Linux. It is written in C# and aimed at developers who want to embed or serve local models in .NET applications.
Tags
Categories
A concise summary has not been added yet.
FAQ
Frequently asked questions
- What is zhongkaifu/TensorSharp?
- TensorSharp is a .NET inference engine and agent runtime for local GGUF models, offering a CLI, browser chat, iPhone app and Ollama/OpenAI-compatible APIs. It supports text, multimodal input, embeddings, image and video generation, personal knowledge collections and agent skills, running on managed C# CPU kernels or native CUDA, Metal and Vulkan backends across Windows, macOS, iOS and Linux. It is written in C# and aimed at developers who want to embed or serve local models in .NET applications.
- How much does zhongkaifu/TensorSharp cost?
- zhongkaifu/TensorSharp uses a Open source pricing model. Check the official website for current plans.
- What is zhongkaifu/TensorSharp used for?
- zhongkaifu/TensorSharp is listed on TolsAI under: Open Source.
- Where can I use zhongkaifu/TensorSharp?
- zhongkaifu/TensorSharp is available on its official website, github.com.
Explore
More in Open Source
An open-source agentic harness for a self-improving AI agent that plans and executes tasks you describe.
A vectorless, reasoning-based RAG engine that indexes documents as trees and retrieves with LLM reasoning.
A PyTorch-like Python library to build and auto-optimize LLM workflows such as chatbots, RAG and agents.
A modular web UI for generating images, video and audio with AI models like Stable Diffusion, Flux and Wan.
A step-by-step guide to designing AI systems built on LLMs, RAG, and AI agents.
Open-source AI pipeline engine for building, debugging and deploying LLM workflows and agent orchestration from your IDE.
Discussion
Discussion
Log in to join the discussion
No comments yet. Start the discussion.