Qwen2.5 72B Instruct
Qwen2.5-72B-Instruct-GGUF is a quantized version of the Qwen2.5-72B-Instruct large language model provided in GGUF format on Hugging Face. It is distributed by bartowski and supports a specific chat template for instruction following and tool calling. The template defines behavior for system prompts, defaulting to the identity of Qwen created by Alibaba Cloud as a helpful assistant, and includes structured XML-based handling for function calls with JSON arguments when tools are supplied.
The repository contains the necessary prompt formatting logic to enable the model to process messages, insert tool definitions within designated XML tags, and generate tool calls in a precise format enclosed in tool_call tags. This implementation allows the model to operate with one or more functions during inference. The GGUF format itself is intended to facilitate local execution through compatible engines.
It belongs to the class of foundation models released for open use. No pricing, licensing terms, or specific hardware requirements are stated in the page content.
Overview
4 featuresQwen2.5 72B Instruct is a Text generation project. It focuses on running large language models locally without relying on cloud APIs. Qwen2.5 72B Instruct is an open-source project aimed at developers. The project is open source (MIT). It ships for the web and the command line, and it can be self-hosted.
bartowski builds and maintains Qwen2.5 72B Instruct, and it first shipped in 2023. Development happens publicly on GitHub with 121.2k stars and 1.2k commits in the last 90 days. It competes in a saturated segment with 25 similar projects in PulseGate's index. Among its 4 catalogued features are GGUF Format, Quantized Weights, and Tool Calling.
Summary written by a language model from the project’s public pages.
- GGUF Format
- Quantized Weights
- Tool Calling
- Local Inference
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 18:09 UTCbartowski/Qwen2.5-72B-Instruct-GGUF verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Qwen2.5 72B Instruct
- What does Qwen2.5 72B Instruct do?
- Qwen2.5 72B Instruct focuses on running large language models locally without relying on cloud APIs. It is catalogued under Text generation on PulseGate.
- Who is Qwen2.5 72B Instruct for?
- Qwen2.5 72B Instruct is an open-source project built for developers.
- Does Qwen2.5 72B Instruct have a free plan?
- Yes — Qwen2.5 72B Instruct is open source under the MIT license and free to use.
- What platforms does Qwen2.5 72B Instruct run on?
- Qwen2.5 72B Instruct runs on the web and the command line. It can also be self-hosted.
- Is Qwen2.5 72B Instruct still maintained?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What are alternatives to Qwen2.5 72B Instruct?
- Similar projects tracked by PulseGate include Qwen2.5 14B Instruct, Qwen2.5 32B Instruct, and Qwen2.5 7B Instruct.Qwen2.5 14B InstructQwen2.5 32B InstructQwen2.5 7B Instruct
- Who makes Qwen2.5 72B Instruct?
- Qwen2.5 72B Instruct is developed by bartowski.
- When did Qwen2.5 72B Instruct launch?
- Qwen2.5 72B Instruct first shipped in 2023.
Similar projects
Closest matches by what these projects do