llm-inspector is an open-source CLI tool that provides real-time monitoring and observability for large language model (LLM) inference. It offers detailed metrics on inference performance, GPU usage, and supports various LLM backends such as Ollama and vLLM. Designed for machine learning engineers seeking insight into LLM operations.
In the LLM eval & observability space, llm-inspector takes a focused approach. It focuses on monitoring and measuring the performance of large language model inference in real time. It is built as an open-source project for machine learning engineers. llm-inspector is open source under the MIT license. llm-inspector is available on the command line.
Behind llm-inspector is Helasaoudi, and the product first shipped in 2026. Key capabilities include LLM monitoring, inference metrics, and GPU usage.
Latest indexed changes and source events
llm-inspector verified by the PulseGate indexer
Other apps tracked under the same category.
