Llama 3.1 8B Instruct
Llama-3.1-8B-Instruct-4bit is a 4-bit MLX conversion of Meta's Llama 3.1 8B Instruct model for local inference on Apple silicon. Developers can download and run the quantised weights with MLX-compatible tooling.
Overview
6 featuresLlama 3.1 8B Instruct is a Foundation models & chat project. It focuses on running an open-weight Llama language model locally with reduced memory requirements. Llama 3.1 8B Instruct is an open-source project aimed at developers and machine-learning practitioners. The project is open source (Open Source). Llama 3.1 8B Instruct is available on the command line, and it can be self-hosted.
It is developed by mlx-community. PulseGate's similarity index places it among 14 comparable projects. Key capabilities include 4-bit quantization, instruction tuning, and local inference.
Summary written by a language model from the project’s public pages.
- 4-bit quantization
- Instruction tuning
- Local inference
- MLX format
- Chat template
- Tool calling
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- studio in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed29 Aug · 11:03 UTCmlx-community/Llama-3.1-8B-Instruct-4bit verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3.1 8B Instruct
- What is Llama 3.1 8B Instruct?
- Llama 3.1 8B Instruct focuses on running an open-weight Llama language model locally with reduced memory requirements. It is catalogued under Foundation models & chat on PulseGate.
- Who is Llama 3.1 8B Instruct for?
- Llama 3.1 8B Instruct is an open-source project built for developers and machine-learning practitioners.
- Is Llama 3.1 8B Instruct free?
- Yes — Llama 3.1 8B Instruct is open source under the Open Source license and free to use.
- What platforms does Llama 3.1 8B Instruct run on?
- Llama 3.1 8B Instruct runs on the command line. It can also be self-hosted.
- Is Llama 3.1 8B Instruct still active?
- Unverified. Llama 3.1 8B Instruct has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What projects are similar to Llama 3.1 8B Instruct?
- Similar projects tracked by PulseGate include Llama 3.2 3B Instruct Bnb, Llama 3.1 8B Instruct, and Llama 3.1 8B Instruct.Llama 3.2 3B Instruct BnbLlama 3.1 8B InstructLlama 3.1 8B Instruct
- Who develops Llama 3.1 8B Instruct?
- Llama 3.1 8B Instruct is developed by mlx-community.
- Is Llama 3.1 8B Instruct open source?
- Yes — Llama 3.1 8B Instruct is open source under the Open Source license.
Similar projects
Closest matches by what these projects do