MicroLLM-004-Q4_K_M-GGUF is a quantized large language model in GGUF format, designed for efficient local inference and conversational AI tasks. It is suitable for developers and researchers who want to deploy or experiment with LLMs on their own infrastructure, supporting CLI and local deployment.
In the Foundation models & chat space, MicroLLM 004 Q4 K M takes a focused approach. It enables developers to run a quantized conversational language model locally for AI and chatbot applications. MicroLLM 004 Q4 K M is an open-source project aimed at AI developers and researchers. The project is open source (Open Source). MicroLLM 004 Q4 K M is available on the command line, and it can be self-hosted.
Darlanio builds and maintains MicroLLM 004 Q4 K M, and the product first shipped in 2024. Among its 5 catalogued features are Conversational AI, local inference, and GGUF format.
Latest indexed changes and source events
Darlanio/MicroLLM-004-Q4_K_M-GGUF verified by the PulseGate indexer
Other apps tracked under the same category.