This repository hosts GGUF quantized versions of Firefunction-v2, a language model specifically tuned for reliable function calling and tool use. The various quantization formats allow efficient local execution using common inference engines. It is designed for developers creating AI agents and applications that need structured output and tool integration without relying on cloud APIs.
Firefunction sits in PulseGate's Foundation models & chat category. It focuses on running function-calling capable LLMs locally with efficient quantization for tool-using applications. Firefunction is an open-source project aimed at developers building AI agents. The project is open source (MIT). Firefunction is available on the web, the command line, and API.
Behind Firefunction is Maziyar Panahi, and it first shipped in 2023. Development happens publicly on GitHub with 122.5k stars and 1.2k commits in the last 90 days. Among its 4 catalogued features are Function Calling, Tool Use, and Quantized GGUF.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do