A collection of GGUF quantized files for Microsoft's Phi-3.5-mini-instruct 3.8B parameter model. It offers various quantization levels (IQ, Q2_K through Q5_K) for different performance and memory tradeoffs. Designed for use with local LLM runners such as llama.cpp, LM Studio, or Ollama.
In the Foundation models & chat space, Phi 3.5 Mini Instruct takes a focused approach. It focuses on running Microsoft Phi-3.5 language models efficiently on consumer hardware and in local applications. Phi 3.5 Mini Instruct is an open-source project aimed at developers. The project is open source (Open Source). The product ships for the web, the command line, and API.
Behind Phi 3.5 Mini Instruct is MaziyarPanahi, and the product first shipped in 2024. Among its 3 catalogued features are multiple quantization levels, GGUF format, and chat template.
Latest indexed changes and source events
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF verified by the PulseGate indexer
Other apps tracked under the same category.
