MicroLLM-004-Q4_K_M-GGUF is a quantized large language model in GGUF format, designed for efficient local inference and conversational AI tasks. It is suitable for developers and researchers who want to deploy or experiment with LLMs on their own infrastructure, supporting CLI and local deployment.
MicroLLM 004 Q4 K M is a Quantised & converted weights project. It enables developers to run a quantized conversational language model locally for AI and chatbot applications. MicroLLM 004 Q4 K M is an open-source project aimed at AI developers and researchers. MicroLLM 004 Q4 K M is open source under the Open Source license. It runs on the command line, and it can be self-hosted.
Darlanio builds and maintains MicroLLM 004 Q4 K M, and it first shipped in 2024. Key capabilities include Conversational AI, local inference, and GGUF format.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do