Skip to content
Back to the index

llmeter

github.comInfrastructure

PulseGate's liveness check found it on 13 Sep 2026; it is registered on GitHub and PyPI and has been in the index since 27 Jun 2026. How this is checked

llmeter is an open-source CLI tool that enables developers and researchers to profile the latency and throughput of large language models (LLMs). It provides cross-platform support for performance testing and optimization of AI workloads.

Inferred · not functionally tested

Open SourceApache-2.0CLI
llmeter preview
Visit github.com
40stars
5forks
5features
2024since

Overview

5 features

Purpose: Measuring and profiling the latency and throughput of large language models for performance optimization.

Inferred · not functionally tested

Audience: AI developers and researchers

Inferred · not functionally tested

Functions: analytics, monitoring

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: unknown

Recorded constraints: pricing: open_source · license: Apache-2.0 · platforms: CLI · deployment: cli

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: github.com. These links do not verify the individual claims.

In the CLI tools & terminal space, llmeter takes a focused approach. Inferred · not functionally tested: It focuses on measuring and profiling the latency and throughput of large language models for performance optimization. Inferred · not functionally tested: It is built as an open-source project for AI developers and researchers. Basis unknown · not verified: llmeter is open source under the Apache-2.0 license. Basis unknown · not verified: It runs on the command line.

awslabs builds and maintains llmeter, and it first shipped in 2024. Development happens publicly on GitHub with 40 stars and 105 commits in the last 90 days. Inferred · not functionally tested: Among its 5 catalogued features are latency profiling, throughput measurement, and cross-platform.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Latency profiling
  • Throughput measurement
  • Cross-platform
  • LLM support
  • Performance testing

Topics: Inferred · not functionally tested

Tags
llm-profilinglatency-testingperformance-benchmark
AI capabilities
Text

JSON profile · Text profile · Access guide

Built with & integrations

AI providers
anthropicopenai
Runs on
CLI

Trust & compliance

License
Apache-2.0
Public signals
HTTPSOpen SourceFree tierGitHub · ★ 40Active maintenance

Indexing history

What PulseGate has recorded for this listing

Nothing recorded for this listing in this window.

Frequently asked questions about llmeter

What does llmeter do?
Inferred · not functionally tested: Llmeter focuses on measuring and profiling the latency and throughput of large language models for performance optimization. It is catalogued under CLI tools & terminal on PulseGate.
Who should use llmeter?
Inferred · not functionally tested: llmeter is an open-source project built for AI developers and researchers.
Is llmeter free?
Basis unknown · not verified: Yes — llmeter is open source under the Apache-2.0 license and free to use.
What platforms does llmeter run on?
Basis unknown · not verified: llmeter runs on the command line.
Is llmeter still maintained?
PulseGate's liveness check found it on 13 Sep 2026. Its GitHub repository shows 105 commits in the last 90 days.
What projects are similar to llmeter?
Similar projects tracked by PulseGate include llm, llm-usage-report, and LMtoolbox.llmllm-usage-reportLMtoolbox
Who makes llmeter?
llmeter is developed by awslabs.
When did llmeter launch?
llmeter first shipped in 2024.

Similar projects

Closest matches by what these projects do