node-llama-cpp is an open-source infrastructure library that provides Node.js bindings for llama.cpp, allowing developers to run large language models locally on their machines. It supports various hardware backends and offers features like function calling and JSON schema enforcement.
node-llama-cpp is an Infrastructure & Backend product. Enabling developers to run large language models locally in Node.js environments without cloud dependencies. node-llama-cpp is an open-source project aimed at node.js developers and AI researchers. The project is open source (MIT). The product ships for the web and the command line, and it can be self-hosted.
node-llama-cpp first shipped in 2023. The project is developed in the open on GitHub with 2.1k stars and 2 commits in the last 90 days. Among its 5 catalogued features are node.js bindings, local inference, and CUDA support. It exposes integrations via a public API.
Latest indexed changes and source events
Other apps tracked under the same category.
