node-llama-cpp
PulseGate's liveness check found it on 9 Oct 2026; it is registered on GitHub and has been in the index since 16 Jun 2026. How this is checked
node-llama-cpp is an open-source infrastructure library that provides Node.js bindings for llama.cpp, allowing developers to run large language models locally on their machines. It supports various hardware backends and offers features like function calling and JSON schema enforcement.
Inferred · not functionally tested
Overview
5 featuresPurpose: Enabling developers to run large language models locally in Node.js environments without cloud dependencies.
Inferred · not functionally tested
Audience: Node.js developers and AI researchers
Inferred · not functionally tested
Functions: code_generation, agents
Inferred · not functionally tested
Interfaces: API: indicated (inferred, not tested) · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)
Recorded constraints: pricing: open_source · license: MIT · platforms: API, WEB · deployment: browser, cli, self_hosted
Constraint provenance is unknown; confirm requirements with the publisher.
Record sources: node-llama-cpp.withcat.ai · github.com. These links do not verify the individual claims.
node-llama-cpp sits in PulseGate's Inference & model serving category. Inferred · not functionally tested: Enabling developers to run large language models locally in Node.js environments without cloud dependencies. Inferred · not functionally tested: node-llama-cpp is an open-source project aimed at node.js developers and AI researchers. Basis unknown · not verified: The project is open source (MIT). Basis unknown · not verified: It ships for the web and the command line, and it can be self-hosted.
node-llama-cpp first shipped in 2023. The project is developed in the open on GitHub with 2.1k stars and 2 commits in the last 90 days. Inferred · not functionally tested: Key capabilities include node.js bindings, local inference, and CUDA support. Inferred · not functionally tested: Catalogued interfaces include a public API.
Summary written by a language model from the project’s public pages.
Tasks: Inferred · not functionally tested
- Node.js bindings
- Local inference
- CUDA support
- Metal support
- Function calling
Topics: Inferred · not functionally tested
Built with & integrations
- Vue
- bdata-v- in the HTML
- local_oss
- bllama in the HTML
Trust & compliance
Indexing history
What PulseGate has recorded for this listing
Frequently asked questions about node-llama-cpp
- What is node-llama-cpp?
- Inferred · not functionally tested: Enabling developers to run large language models locally in Node.js environments without cloud dependencies. It is catalogued under Inference & model serving on PulseGate.
- Who should use node-llama-cpp?
- Inferred · not functionally tested: node-llama-cpp is an open-source project built for node.js developers and AI researchers.
- Is node-llama-cpp free?
- Basis unknown · not verified: Yes — node-llama-cpp is open source under the MIT license and free to use.
- What platforms does node-llama-cpp run on?
- Basis unknown · not verified: node-llama-cpp runs on the web and the command line. It can also be self-hosted.
- Is node-llama-cpp still active?
- PulseGate's liveness check found it on 9 Oct 2026. Its GitHub repository shows 2 commits in the last 90 days.
- How long has node-llama-cpp been around?
- node-llama-cpp first shipped in 2023.
- Is node-llama-cpp open source?
- Basis unknown · not verified: Yes — node-llama-cpp is open source under the MIT license, developed on GitHub.
- Does node-llama-cpp have an API or integrations?
- Inferred · not functionally tested: Yes — node-llama-cpp exposes a public API.
Similar projects
Closest matches by what these projects do