inferbench-cli
inferbench-cli is an open-source CLI tool for benchmarking local LLM inference speed and providing hardware configuration advice for omlx and llama.cpp. It helps developers and researchers optimize AI model performance on their own machines.
Overview
5 featuresinferbench-cli sits in PulseGate's LLM evaluation & benchmarks category. It focuses on measuring and optimizing local LLM inference performance on user hardware. inferbench-cli is an open-source project aimed at AI developers and researchers. The project is open source (Apache-2.0). It ships for the command line, and it can be self-hosted.
Behind inferbench-cli is Rudrendu Paul, and it first shipped in 2026. Development happens publicly on GitHub with 15 commits in the last 90 days. Among its 5 catalogued features are LLM benchmarking, hardware advisor, and token/sec measurement.
Summary written by a language model from the project’s public pages.
- LLM benchmarking
- Hardware advisor
- Token/sec measurement
- Local inference
- CLI interface
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed18 Jul · 18:21 UTCinferbench-cli verified via PyPI Bulk EnumeratorSource: PyPI Bulk Enumerator · Open
Frequently asked questions about inferbench-cli
- What is inferbench-cli?
- Inferbench-cli focuses on measuring and optimizing local LLM inference performance on user hardware. It is catalogued under LLM evaluation & benchmarks on PulseGate.
- Who should use inferbench-cli?
- inferbench-cli is an open-source project built for AI developers and researchers.
- Does inferbench-cli have a free plan?
- Yes — inferbench-cli is open source under the Apache-2.0 license and free to use.
- What platforms does inferbench-cli run on?
- inferbench-cli runs on the command line. It can also be self-hosted.
- Is inferbench-cli still active?
- The GitHub repository shows 15 commits in the last 90 days.
- What projects are similar to inferbench-cli?
- Similar projects tracked by PulseGate include llm-benchmark-runner, Localmaxxing, and BenchLoop.llm-benchmark-runnerLocalmaxxingBenchLoop
- Who makes inferbench-cli?
- inferbench-cli is developed by Rudrendu Paul.
- When did inferbench-cli launch?
- inferbench-cli first shipped in 2026.
Similar projects
Closest matches by what these projects do