This is a 4-bit quantized version of the LFM2-24B model using the MLX framework, optimized for Apple silicon devices. Hosted by the LM Studio community, it enables efficient local inference of a large language model on Macs. The model includes a comprehensive chat template supporting tools and system prompts.
In the Foundation models & chat space, LFM2 24B A2B takes a focused approach. It focuses on running a 24B parameter language model efficiently on Apple silicon hardware using MLX quantization. LFM2 24B A2B is an open-source project aimed at developers. The project is open source (MIT). LFM2 24B A2B is available on the web, the command line, and API.
Behind LFM2 24B A2B is lmstudio-community, and the product first shipped in 2023. The project is developed in the open on GitHub with 6.4k stars and 19 commits in the last 90 days. PulseGate's similarity index places it among 6 comparable tools. Among its 4 catalogued features are MLX Quantization, 4-bit, and Apple Silicon.
Latest indexed changes and source events
lmstudio-community/LFM2-24B-A2B-MLX-4bit verified by the PulseGate indexer
Other apps tracked under the same category.
