LFM2 24B A2B
This repository hosts an 8-bit quantized MLX version of the LFM2-24B model optimized for Apple Silicon. It includes a custom chat template with system prompt and tool support. The model is designed for local inference on Macs using the MLX framework and is distributed via Hugging Face.
Overview
4 featuresIn the Foundation models & chat space, LFM2 24B A2B takes a focused approach. It focuses on running a 24B parameter language model efficiently on Apple Silicon devices using the MLX framework. LFM2 24B A2B is an open-source project aimed at developers. The project is open source (MIT). LFM2 24B A2B is available on the web, the command line, and API.
lmstudio-community builds and maintains LFM2 24B A2B, and it first shipped in 2023. The project is developed in the open on GitHub with 6.3k stars and 28 commits in the last 90 days. Among its 4 catalogued features are 8-bit Quantization, MLX Format, and Apple Silicon Optimized.
Summary written by a language model from the project’s public pages.
- 8-bit Quantization
- MLX Format
- Apple Silicon Optimized
- System Prompt Support
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · studio in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed19 Jul · 20:51 UTClmstudio-community/LFM2-24B-A2B-MLX-8bit verified via Hugging Face EnumeratorSource: Hugging Face Enumerator · Open
Frequently asked questions about LFM2 24B A2B
- What is LFM2 24B A2B?
- LFM2 24B A2B focuses on running a 24B parameter language model efficiently on Apple Silicon devices using the MLX framework. It is catalogued under Foundation models & chat on PulseGate.
- Who is LFM2 24B A2B for?
- LFM2 24B A2B is an open-source project built for developers.
- Is LFM2 24B A2B free?
- Yes — LFM2 24B A2B is open source under the MIT license and free to use.
- What platforms does LFM2 24B A2B run on?
- LFM2 24B A2B runs on the web, the command line, and API.
- Is LFM2 24B A2B still active?
- The GitHub repository shows 28 commits in the last 90 days.
- What projects are similar to LFM2 24B A2B?
- Similar projects tracked by PulseGate include LFM2 24B A2B, LFM2 24B A2B, and LFM2 24B A2B.LFM2 24B A2BLFM2 24B A2BLFM2 24B A2B
- Who develops LFM2 24B A2B?
- LFM2 24B A2B is developed by lmstudio-community.
- How long has LFM2 24B A2B been around?
- LFM2 24B A2B first shipped in 2023.
Similar projects
Closest matches by what these projects do