inferguard is a CLI tool for read-only diagnostics and benchmarking of large language model serving frameworks such as vLLM, SGLang, Dynamo, and llm-d. It helps infrastructure engineers analyze serving performance and identify bottlenecks. The tool is open source and designed for advanced LLM deployment environments.
Latest indexed changes and source events
Other apps tracked under the same category.
