inferhost is an open-source CLI tool and API that allows users to run Hugging Face GGUF models locally for chat, vision, text-to-speech, and image generation. It provides an OpenAI-compatible endpoint and supports multiple modalities, making it ideal for developers seeking local, self-hosted AI solutions.
Latest indexed changes and source events
Other apps tracked under the same category.