llm-bench-cost
CLI tool for comparing LLM API pricing, ranked by cost-effectiveness against LMSYS Arena scores
Open SourceMITWebCLI
Overview
5 featuresllm-bench-cost is a LLM eval & observability project. It focuses on comparing and evaluating the cost-effectiveness of different LLM API providers. It is built as an open-source project for AI developers and researchers. The project is open source (MIT). It ships for the web and the command line.
Behind llm-bench-cost is xiapuyang, and it first shipped in 2026. Development happens publicly on GitHub with 33 commits in the last 90 days. Key capabilities include LLM pricing comparison, cost-effectiveness ranking, and CLI interface.
- LLM pricing comparison
- Cost-effectiveness ranking
- CLI interface
- LMSYS Arena integration
- Open source
Tags
llm-pricingapi-comparisoncost-analysiscli-toolopen-source
AI capabilities
Weights: Open
Built with & integrations
Runs on
BrowserCLI
Trust & compliance
License
MIT
Verified signals
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about llm-bench-cost
- What is llm-bench-cost?
- Llm-bench-cost focuses on comparing and evaluating the cost-effectiveness of different LLM API providers. It is catalogued under LLM eval & observability on PulseGate.
- Who should use llm-bench-cost?
- llm-bench-cost is an open-source project built for AI developers and researchers.
- Is llm-bench-cost free?
- Yes — llm-bench-cost is open source under the MIT license and free to use.
- What platforms does llm-bench-cost run on?
- llm-bench-cost runs on the web and the command line.
- Is llm-bench-cost still active?
- The GitHub repository shows 33 commits in the last 90 days.
- What are alternatives to llm-bench-cost?
- Similar projects tracked by PulseGate include llmprices, llm-agent-bench, and BenchLLM.llmpricesllm-agent-benchBenchLLM
- Who makes llm-bench-cost?
- llm-bench-cost is developed by xiapuyang.
- When did llm-bench-cost launch?
- llm-bench-cost first shipped in 2026.
Similar projects
Closest matches by what these projects do