Inkling Small
A small quantized language model (NVFP4 format) with custom system prompts for controlling reasoning effort levels. Supports tool calling and specialized message formatting for structured interactions. Optimized for efficient local inference while maintaining advanced capabilities.
Open SourceApache-2.0WebCLIAPI
4.0kstars
503forks
2alternatives
4features
2025since
Overview
4 featuresIn the Foundation models & chat space, Inkling Small takes a focused approach. It focuses on running a compact, quantized LLM locally with configurable reasoning depth and tool-calling abilities. It is built as an open-source project for developers. The project is open source (Apache-2.0). It ships for the web, the command line, and API.
It is developed by Thinking Machines, and it first shipped in 2025. The project is developed in the open on GitHub with 4k stars and 72 commits in the last 90 days. Key capabilities include Reasoning Effort Control, Tool Integration, and GGUF Quantization.
Summary written by a language model from the project’s public pages.
- Reasoning Effort Control
- Tool Integration
- GGUF Quantization
- Custom Prompt Templates
Tags
small-llmquantized-modelreasoning-controltool-use-llm
AI capabilities
Multimodal
Inference: LocalWeights: Open
Built with & integrations
Hosting
AWS
AI providers
local_ossopenai
Runs on
BrowserCLIAPI-only
Detected from
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML
Trust & compliance
License
Apache-2.0
Verified signals
Indexing history
1What PulseGate has recorded for this listing
- Indexed5 Aug · 10:38 UTCthinkingmachines/Inkling-Small-NVFP4 verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Inkling Small
- What does Inkling Small do?
- Inkling Small focuses on running a compact, quantized LLM locally with configurable reasoning depth and tool-calling abilities. It is catalogued under Foundation models & chat on PulseGate.
- Who should use Inkling Small?
- Inkling Small is an open-source project built for developers.
- Does Inkling Small have a free plan?
- Yes — Inkling Small is open source under the Apache-2.0 license and free to use.
- What platforms does Inkling Small run on?
- Inkling Small runs on the web, the command line, and API.
- Is Inkling Small still active?
- The GitHub repository shows 72 commits in the last 90 days.
- What are alternatives to Inkling Small?
- Similar projects tracked by PulseGate include Inkling Small, Inkling, and Inkling LM.Inkling SmallInklingInkling LM
- Who makes Inkling Small?
- Inkling Small is developed by Thinking Machines.
- When did Inkling Small launch?
- Inkling Small first shipped in 2025.
Similar apps
Closest matches by what these projects do