This repository hosts an 8-bit quantized MLX version of the LFM2-24B model optimized for Apple Silicon. It includes a custom chat template with system prompt and tool support. The model is designed for local inference on Macs using the MLX framework and is distributed via Hugging Face.
LFM2 24B A2B sits in PulseGate's Foundation models & chat category. It focuses on running a 24B parameter language model efficiently on Apple Silicon devices using the MLX framework. LFM2 24B A2B is an open-source project aimed at developers. The project is open source (MIT). The product ships for the web, the command line, and API.
It is developed by lmstudio-community, and the product first shipped in 2023. The project is developed in the open on GitHub with 6.3k stars and 28 commits in the last 90 days. Among its 4 catalogued features are 8-bit Quantization, MLX Format, and Apple Silicon Optimized.
Latest indexed changes and source events
lmstudio-community/LFM2-24B-A2B-MLX-8bit verified by the PulseGate indexer
Other apps tracked under the same category.
