This is a 4-bit quantized version of the LFM2-24B model using the MLX framework, optimized for Apple silicon devices. Hosted by the LM Studio community, it enables efficient local inference of a large language model on Macs. The model includes a comprehensive chat template supporting tools and system prompts.
LFM2 24B A2B sits in PulseGate's Foundation models & chat category. It focuses on running a 24B parameter language model efficiently on Apple silicon hardware using MLX quantization. LFM2 24B A2B is an open-source project aimed at developers. LFM2 24B A2B is open source under the MIT license. It ships for the web, the command line, and API.
lmstudio-community builds and maintains LFM2 24B A2B, and it first shipped in 2023. The project is developed in the open on GitHub with 6.4k stars and 19 commits in the last 90 days. PulseGate's similarity index places it among 6 comparable projects. Key capabilities include MLX Quantization, 4-bit, and Apple Silicon.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do