Phi-4-mini-instruct-GGUF is a Hugging Face repository containing quantized GGUF versions of Microsoft's Phi-4-mini-instruct language model. Developers can download different quantization levels for local inference with compatible runtimes.
In the Quantised & converted weights space, Phi 4 Mini Instruct takes a focused approach. It focuses on running the Phi-4-mini-instruct language model locally with reduced-size quantized weights. It is built as an open-source project for developers and machine learning practitioners. Phi 4 Mini Instruct is open source under the Apache-2.0 license. Phi 4 Mini Instruct is available on the web, the command line, and API, and it can be self-hosted.
Unsloth builds and maintains Phi 4 Mini Instruct, and it first shipped in 2023. The project is developed in the open on GitHub with 75.5k stars and 2.6k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 6 similar projects. Among its 8 catalogued features are GGUF weights, multiple quantizations, and BF16 weights.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do