llm-speed
llm-speed is an open-source CLI tool that benchmarks the inference speed of large language models (LLMs) across various hardware setups and hosted APIs. It provides reproducible, community-verified results for AI researchers and developers seeking to optimize model performance.
Open SourceApache-2.0CLI
Overview
5 featuresIn the LLM eval & observability space, llm-speed takes a focused approach. It focuses on measuring and comparing LLM inference speed across different hardware and API backends. llm-speed is an open-source project aimed at AI researchers and developers. llm-speed is open source under the Apache-2.0 license. It ships for the command line.
llm-speed first shipped in 2026. The project is developed in the open on GitHub with 4 commits in the last 90 days. Among its 5 catalogued features are LLM benchmarking, token speed measurement, and hardware detection.
Summary written by a language model from the project’s public pages.
- LLM benchmarking
- Token speed measurement
- Hardware detection
- Open source
- Reproducible methodology
Tags
llm-benchmarkingtoken-speedhardware-comparison
AI capabilities
Text
Inference: HybridWeights: Open
Built with & integrations
Framework
Next.js
Hosting
Cloudflare
AI providers
local_ossmeta_llama
Runs on
CLI
Detected from
- Next.js
- x-nextjs-prerender header · /_next/static/ in the HTML · __next_f in the HTML
- local_oss
- bllama in the HTML · bvllm in the HTML
- Cloudflare
- cf-ray header · cf-cache-status header
- meta_llama
- llama- in the HTML
Trust & compliance
License
Apache-2.0
Verified signals
Legal
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about llm-speed
- What does llm-speed do?
- Llm-speed focuses on measuring and comparing LLM inference speed across different hardware and API backends. It is catalogued under LLM eval & observability on PulseGate.
- Who should use llm-speed?
- llm-speed is an open-source project built for AI researchers and developers.
- Is llm-speed free?
- Yes — llm-speed is open source under the Apache-2.0 license and free to use.
- What platforms does llm-speed run on?
- llm-speed runs on the command line.
- Is llm-speed still maintained?
- The GitHub repository shows 4 commits in the last 90 days.
- What projects are similar to llm-speed?
- Similar projects tracked by PulseGate include llm-benchmark-runner, llm-cal, and llm-inspector.llm-benchmark-runnerllm-calllm-inspector
- How long has llm-speed been around?
- llm-speed first shipped in 2026.
- Is llm-speed open source?
- Yes — llm-speed is open source under the Apache-2.0 license, developed on GitHub.
Similar projects
Closest matches by what these projects do