TensorSharp is an open-source inference engine for running GGUF-format large language models locally on .NET platforms. It provides a command-line tool, a web-based chat server, and APIs compatible with OpenAI and Ollama, enabling developers to deploy and interact with LLMs on their own hardware. The project supports GPU acceleration and can be embedded as a C# library.
Latest indexed changes and source events
Show HN: TensorSharp: Open-Source Local LLM Inference Engine discovered by the PulseGate indexer
Other apps tracked under the same category.
