Who is llamathon for?

llamathon is an open-source project built for ML engineers and infrastructure teams.

Does llamathon have a free plan?

Yes — llamathon is open source under the MIT license and free to use.

What platforms does llamathon run on?

llamathon runs on the command line. It can also be self-hosted.

Is llamathon still active?

The GitHub repository shows 15 commits in the last 90 days.

What projects are similar to llamathon?

Similar projects tracked by PulseGate include Localmaxxing, llm-speed, and llm-benchmark-runner.

Is llamathon open source?

Yes — llamathon is open source under the MIT license, developed on GitHub.

Back to the index

llamathon

PyPIInfrastructure

Llamathon is a Python benchmarking tool for LLM inference servers. It orchestrates tests using llama-benchy with automatic hardware and model detection, realistic workload generation, and produces charts and detailed reports. It supports popular backends including Ollama, vLLM, and llama.cpp.

Open SourceMITCLISelf-hosted

Visit PyPI

1star

5features

2026since

Overview

5 features

In the AI & ML space, llamathon takes a focused approach. Accurately measuring and reporting the real-world LLM inference performance and capacity of a server. It is built as an open-source project for ML engineers and infrastructure teams. llamathon is open source under the MIT license. It runs on the command line, and it can be self-hosted.

llamathon first shipped in 2026. The project is developed in the open on GitHub with 15 commits in the last 90 days. Among its 5 catalogued features are LLM Benchmarking, Inference Testing, and auto-detection.

Summary written by a language model from the project’s public pages.

LLM Benchmarking
Inference Testing
Auto-detection
Performance Reports
Charts

Built with & integrations

Runs on

CLISelf-hosted

Trust & compliance

License

MIT

Verified signals

HTTPSOpen Source GitHub · ★ 1Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed24 Jul · 08:21 UTC
llamathon verified against its public source
Source: PulseGate · Open

Frequently asked questions about llamathon

What is llamathon?: Accurately measuring and reporting the real-world LLM inference performance and capacity of a server. It is catalogued under AI & ML on PulseGate.
Who is llamathon for?: llamathon is an open-source project built for ML engineers and infrastructure teams.
Does llamathon have a free plan?: Yes — llamathon is open source under the MIT license and free to use.
What platforms does llamathon run on?: llamathon runs on the command line. It can also be self-hosted.
Is llamathon still active?: The GitHub repository shows 15 commits in the last 90 days.
What projects are similar to llamathon?: Similar projects tracked by PulseGate include Localmaxxing, llm-speed, and llm-benchmark-runner.Localmaxxing llm-speed llm-benchmark-runner
How long has llamathon been around?: llamathon first shipped in 2026.
Is llamathon open source?: Yes — llamathon is open source under the MIT license, developed on GitHub.

At a glance

Platforms: Cli
Languages: English
Open source: Yes · ★ 1
License: MIT
First seen: 24 Jul 2026
Built for: ML engineers and infrastructure teams
Model: Open source
Solves: Accurately measuring and reporting the real-world LLM inference performance and capacity of a server.

Registered as

GitHub: qthullie/Llamathon
PyPI: llamathon

Developer

Qthullie

Solo developer

GitHub

Open source

View on GitHub

Stars: 1
Forks: 0
Open issues: 0
Last commit: 24 Jul 2026
Commits 90d: 15
Contributors: 1
Authorship: Solo
Default branch: main

Live coverage

Identity confidence: Low · 64
Indexed: 24 Jul 2026
Lifecycle: Alive
First seen: Jul 2026
Last seen: 24 Jul 2026

Identity audit (13)

Slug: llamathon-pypi-org
Lifecycle state recorded: 24 Jul 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 24 Jul 2026
Timeline basis: Indexed-at chronology (no inferred launch/funding milestones).
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Last updated: 24 Jul 2026
Canonical URL: https://pypi.org/project/llamathon

Ship this? Send a correction — no account, and you get a link to follow it.

Similar apps

Closest matches by what these projects do