Localdeploy is a Python package that offers both a local web interface and an OpenAI-compatible API server. It enables developers to easily select, run, and benchmark large language models using Ollama and other local inference runtimes. Key capabilities include VRAM monitoring, performance benchmarking, and self-hosted deployment without relying on cloud AI services.
localdeploy is an AI & ML product. Running, selecting, and benchmarking local LLMs without cloud dependencies or complex setup. It is built as an open-source project for developers. localdeploy is open source under the MIT license. localdeploy is available on the command line and the web, and it can be self-hosted.
localdeploy first shipped in 2026. Key capabilities include Local Model Runner, Web UI, and OpenAI Compatible API. It exposes integrations via a public API.
Latest indexed changes and source events
Other apps tracked under the same category.
