hearth-llm
hearth-llm acts as a proxy for llama.cpp's llama-server, maintaining persistent key-value caches to keep local LLM contexts warm across sessions. This avoids expensive recomputation when resuming conversations or tasks with large language models. It is a lightweight developer tool aimed at improving the performance and responsiveness of local LLM inference setups.
Open SourceMITCLISelf-hosted
Overview
3 featuresIn the AI & ML space, hearth-llm takes a focused approach. It focuses on losing LLM context and having to rebuild KV caches every time a local model session restarts. It is built as an open-source project for developers. hearth-llm is open source under the MIT license. hearth-llm is available on the command line, and it can be self-hosted.
hearth-llm first shipped in 2026. Key capabilities include KV Cache Persistence, LLM Proxy, and llama.cpp Integration.
Summary written by a language model from the project’s public pages.
- KV Cache Persistence
- LLM Proxy
- llama.cpp Integration
Tags
llm-proxykv-cachellama-cpplocal-inference
AI capabilities
Text
Inference: Local
Built with & integrations
Runs on
CLISelf-hosted
Trust & compliance
License
MIT
Verified signals
HTTPSOpen Source
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about hearth-llm
- What does hearth-llm do?
- Hearth-llm focuses on losing LLM context and having to rebuild KV caches every time a local model session restarts. It is catalogued under AI & ML on PulseGate.
- Who is hearth-llm for?
- hearth-llm is an open-source project built for developers.
- Is hearth-llm free?
- Yes — hearth-llm is open source under the MIT license and free to use.
- What platforms does hearth-llm run on?
- hearth-llm runs on the command line. It can also be self-hosted.
- Is hearth-llm still maintained?
- Unverified. hearth-llm has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What projects are similar to hearth-llm?
- Similar projects tracked by PulseGate include Cliprise, chi-ai, and AI DocuChat.Cliprisechi-aiAI DocuChat
- When did hearth-llm launch?
- hearth-llm first shipped in 2026.
- Is hearth-llm open source?
- Yes — hearth-llm is open source under the MIT license.
Also in AI & ML
Same category — not a similarity match