llm-inspector
llm-inspector is an open-source CLI tool that provides real-time monitoring and observability for large language model (LLM) inference. It offers detailed metrics on inference performance, GPU usage, and supports various LLM backends such as Ollama and vLLM. Designed for machine learning engineers seeking insight into LLM operations.
Overview
5 featuresIn the LLM eval & observability space, llm-inspector takes a focused approach. It focuses on monitoring and measuring the performance of large language model inference in real time. llm-inspector is an open-source project aimed at machine learning engineers. llm-inspector is open source under the MIT license. llm-inspector is available on the command line.
It is developed by Helasaoudi, and it first shipped in 2026. Among its 5 catalogued features are LLM monitoring, inference metrics, and GPU usage.
Summary written by a language model from the project’s public pages.
- LLM monitoring
- Inference metrics
- GPU usage
- CLI interface
- Observability
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about llm-inspector
- What is llm-inspector?
- Llm-inspector focuses on monitoring and measuring the performance of large language model inference in real time. It is catalogued under LLM eval & observability on PulseGate.
- Who is llm-inspector for?
- llm-inspector is an open-source project built for machine learning engineers.
- Is llm-inspector free?
- Yes — llm-inspector is open source under the MIT license and free to use.
- What platforms does llm-inspector run on?
- llm-inspector runs on the command line.
- Is llm-inspector still active?
- Unverified. llm-inspector has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What projects are similar to llm-inspector?
- Similar projects tracked by PulseGate include llm4s, llm-cal, and llm-benchmark-runner.llm4sllm-calllm-benchmark-runner
- Who makes llm-inspector?
- llm-inspector is developed by Helasaoudi.
- How long has llm-inspector been around?
- llm-inspector first shipped in 2026.
Similar projects
Closest matches by what these projects do