A collection of GGUF quantized files for Microsoft's Phi-3.5-mini-instruct 3.8B parameter model. It offers various quantization levels (IQ, Q2_K through Q5_K) for different performance and memory tradeoffs. Designed for use with local LLM runners such as llama.cpp, LM Studio, or Ollama.
Phi 3.5 Mini Instruct sits in PulseGate's Text generation category. It focuses on running Microsoft Phi-3.5 language models efficiently on consumer hardware and in local applications. Phi 3.5 Mini Instruct is an open-source project aimed at developers. The project is open source (Open Source). It runs on the web, the command line, and API.
MaziyarPanahi builds and maintains Phi 3.5 Mini Instruct, and it first shipped in 2024. Among its 3 catalogued features are multiple quantization levels, GGUF format, and chat template.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do