CLI for benchmarking LLM inference servers (vLLM, SGLang, llama.cpp)
llm-grill sits in PulseGate's LLM eval & observability category. It focuses on benchmarking and comparing the performance of different LLM inference servers. llm-grill is an open-source project aimed at AI engineers and researchers. llm-grill is open source under the Apache Software License. It ships for the web and the command line, and it can be self-hosted.
Behind llm-grill is fisheatfish, and it first shipped in 2026. The project is developed in the open on GitHub with 25 commits in the last 90 days. Among its 5 catalogued features are LLM benchmarking, CLI interface, and server compatibility.
What PulseGate has recorded for this listing
Closest matches by what these projects do