Jan-v3.5-4B-GGUF is an open-source 4 billion parameter language model provided in GGUF format for efficient local execution. It supports advanced features including tool calling and function calling through a specialized prompt format. The model is designed for developers seeking to run capable LLMs on-device or in local environments without relying on cloud APIs.
In the Foundation models & chat space, Jan V3.5 4B takes a focused approach. It focuses on running capable 4B language models with tool-calling support efficiently on consumer hardware. Jan V3.5 4B is an open-source project aimed at developers. The project is open source (Open Source). It runs on the web, the command line, and API.
Behind Jan V3.5 4B is JanHQ, and it first shipped in 2023. The project is developed in the open on GitHub with 43.7k stars and 318 commits in the last 90 days. Among its 4 catalogued features are GGUF Quantized, Local Inference, and Tool Calling.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do