A 4-bit quantized version of the LFM2.5 1.2B Instruct model optimized for the MLX framework on Apple Silicon. It is designed for local inference on Macs and includes a chat template suitable for instruction following. The model is distributed via Hugging Face for use with MLX and LM Studio.
LFM2.5 1.2B Instruct is a Quantised & converted weights project. It focuses on running small, efficient language models on Apple Silicon devices using the MLX framework. LFM2.5 1.2B Instruct is an open-source project aimed at machine learning developers. The project is open source (MIT). LFM2.5 1.2B Instruct is available on the web, the command line, and API.
It is developed by LM Studio, and it first shipped in 2023. The project is developed in the open on GitHub with 6.3k stars and 28 commits in the last 90 days. Among its 3 catalogued features are MLX format, 4-bit quantization, and apple silicon optimized.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do