Phi 3.5 Mini Instruct
This repository hosts GGUF quantized versions of Microsoft's Phi-3.5-mini-instruct model. It provides multiple quantization levels (IQ, Q2_K through Q4) for efficient local inference using tools like llama.cpp. The model supports instruction following and is optimized for on-device or CPU/GPU usage without requiring cloud APIs.
Overview
4 featuresPhi 3.5 Mini Instruct is a Text generation project. It focuses on running the Phi-3.5-mini language model efficiently on consumer hardware using quantized GGUF format. It is built as an open-source project for developers and AI enthusiasts. Phi 3.5 Mini Instruct is open source under the MIT license. It runs on the web, the command line, and API.
Behind Phi 3.5 Mini Instruct is bartowski, and it first shipped in 2023. The project is developed in the open on GitHub with 121.2k stars and 1.2k commits in the last 90 days. Key capabilities include GGUF Quantization, Local Inference, and Chat Template. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
- GGUF Quantization
- Local Inference
- Chat Template
- Multiple Quant Levels
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 13:04 UTCbartowski/Phi-3.5-mini-instruct-GGUF verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Phi 3.5 Mini Instruct
- What is Phi 3.5 Mini Instruct?
- Phi 3.5 Mini Instruct focuses on running the Phi-3.5-mini language model efficiently on consumer hardware using quantized GGUF format. It is catalogued under Text generation on PulseGate.
- Who is Phi 3.5 Mini Instruct for?
- Phi 3.5 Mini Instruct is an open-source project built for developers and AI enthusiasts.
- Is Phi 3.5 Mini Instruct free?
- Yes — Phi 3.5 Mini Instruct is open source under the MIT license and free to use.
- What platforms does Phi 3.5 Mini Instruct run on?
- Phi 3.5 Mini Instruct runs on the web, the command line, and API.
- Is Phi 3.5 Mini Instruct still active?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What are alternatives to Phi 3.5 Mini Instruct?
- Similar projects tracked by PulseGate include Phi 3.5 Mini Instruct, Phi 4 Mini Instruct, and Phi 3.5 Mini Instruct.Phi 3.5 Mini InstructPhi 4 Mini InstructPhi 3.5 Mini Instruct
- Who develops Phi 3.5 Mini Instruct?
- Phi 3.5 Mini Instruct is developed by bartowski.
- When did Phi 3.5 Mini Instruct launch?
- Phi 3.5 Mini Instruct first shipped in 2023.
Similar projects
Closest matches by what these projects do