LLMTest is an open-source project that adds an Axera NPU backend to llama.cpp for local GGUF language-model inference. It is intended for developers deploying or testing LLMs on Axera hardware.
LLMTest is a Frameworks & SDKs project. It focuses on running GGUF language models locally on Axera NPU hardware. It is built as an open-source project for developers working with Axera NPU devices and local LLM inference. LLMTest is open source under the Open Source license. It ships for the web and the command line, and it can be self-hosted.
woolcoxm builds and maintains LLMTest. Key capabilities include GGUF model support, Axera NPU backend, and local inference.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do