This repository contains GGUF quantized files of Meta's Llama 3.2 3B Instruct model, maintained by the LM Studio community. It supports tool calling, system prompts, and efficient local execution using tools like llama.cpp. The model is ideal for developers seeking lightweight, locally runnable instruction-tuned LLMs.
Llama 3.2 3B Instruct is a Text generation project. It focuses on enabling efficient local CPU and GPU inference of Llama 3.2 using quantized GGUF format. Llama 3.2 3B Instruct is an open-source project aimed at developers running local LLMs. The project is open source (MIT). Llama 3.2 3B Instruct is available on the web, the command line, and API.
Behind Llama 3.2 3B Instruct is LM Studio Community, and it first shipped in 2023. The project is developed in the open on GitHub with 121.2k stars and 1.2k commits in the last 90 days. The category is crowded — PulseGate's index counts 21 comparable projects. Among its 3 catalogued features are GGUF Quantization, Tool Calling, and Local Inference.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do