MicroLLM-003-Q4_K_M-GGUF is an open-source, quantized language model distributed in GGUF format for efficient local inference. It is designed for integration with CLI tools and supports conversational AI tasks, making it suitable for developers seeking lightweight, local LLM solutions.
MicroLLM 003 Q4 K M sits in PulseGate's Quantised & converted weights category. It allows developers to run efficient, quantized language models locally for conversational AI and automation. It is built as an open-source project for developers and AI enthusiasts. MicroLLM 003 Q4 K M is open source under the MIT license. MicroLLM 003 Q4 K M is available on the command line.
It is developed by Darlanio, and it first shipped in 2023. The project is developed in the open on GitHub with 120.2k stars and 1.2k commits in the last 90 days. Among its 5 catalogued features are quantized model, local inference, and GGUF format.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do