This repository contains GGUF format quantized weights for Meta's Llama 3.2 3B Instruct model, created by bartowski. These files are optimized for use with llama.cpp, LM Studio, and other local LLM inference tools.
In the Text generation space, Llama 3.2 3B Instruct takes a focused approach. It focuses on running the Llama 3.2 3B model efficiently on consumer hardware using GGUF format and tools like llama.cpp. It is built as an open-source project for developers. Llama 3.2 3B Instruct is open source under the MIT license. Llama 3.2 3B Instruct is available on the web, the command line, and API.
It is developed by bartowski (United States), and it first shipped in 2023. The project is developed in the open on GitHub with 121.2k stars and 1.2k commits in the last 90 days. PulseGate's similarity index places it among 16 comparable projects.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do