Phi 3 Mini 4k Instruct
This is a 4-bit GPTQ quantized version of the Phi-3-mini-4k-instruct model. It enables efficient local inference of a capable small language model on consumer hardware. The model supports instruction following and can be used with standard Transformers pipelines or other inference frameworks.
Overview
4 featuresIn the Text generation space, Phi 3 Mini 4k Instruct takes a focused approach. It focuses on running capable language models with significantly reduced memory and compute requirements on local hardware. It is built as an open-source project for developers and researchers. The project is open source (Open Source). It runs on the web, the command line, and API.
It is developed by kaitchup. Among its 4 catalogued features are 4-bit quantization, instruction tuned, and efficient inference.
Summary written by a language model from the project’s public pages.
- 4-bit quantization
- Instruction tuned
- Efficient inference
- Transformers compatible
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 13:02 UTCkaitchup/Phi-3-mini-4k-instruct-gptq-4bit verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Phi 3 Mini 4k Instruct
- What does Phi 3 Mini 4k Instruct do?
- Phi 3 Mini 4k Instruct focuses on running capable language models with significantly reduced memory and compute requirements on local hardware. It is catalogued under Text generation on PulseGate.
- Who should use Phi 3 Mini 4k Instruct?
- Phi 3 Mini 4k Instruct is an open-source project built for developers and researchers.
- Does Phi 3 Mini 4k Instruct have a free plan?
- Yes — Phi 3 Mini 4k Instruct is open source under the Open Source license and free to use.
- What platforms does Phi 3 Mini 4k Instruct run on?
- Phi 3 Mini 4k Instruct runs on the web, the command line, and API.
- Is Phi 3 Mini 4k Instruct still active?
- Unverified. Phi 3 Mini 4k Instruct has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What are alternatives to Phi 3 Mini 4k Instruct?
- Similar projects tracked by PulseGate include Phi 3 Mini 4k Instruct, Phi 3.5 Mini Instruct, and Phi 3.5 Mini Instruct.Phi 3 Mini 4k InstructPhi 3.5 Mini InstructPhi 3.5 Mini Instruct
- Who develops Phi 3 Mini 4k Instruct?
- Phi 3 Mini 4k Instruct is developed by kaitchup.
- Is Phi 3 Mini 4k Instruct open source?
- Yes — Phi 3 Mini 4k Instruct is open source under the Open Source license.
Similar projects
Closest matches by what these projects do