LFM2.5-1.2B-Instruct-MLX-6bit is a 6-bit quantized version of a 1.2 billion parameter instruction-tuned language model optimized for the MLX framework on Apple silicon. It includes a chat template and supports tool use. The model is distributed on Hugging Face for local inference on Macs and is suitable for developers seeking lightweight on-device AI capabilities.
LFM2.5 1.2B Instruct is a Quantised & converted weights project. It focuses on running efficient small language models on Apple silicon hardware using MLX. LFM2.5 1.2B Instruct is an open-source project aimed at developers building local AI apps. The project is open source (MIT). It ships for the web, the command line, and API.
It is developed by LM Studio Community, and it first shipped in 2023. Development happens publicly on GitHub with 6.3k stars and 28 commits in the last 90 days. PulseGate's similarity index places it among 6 comparable projects. Key capabilities include MLX Quantized, 6-bit Quantization, and Instruction Tuned.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do