Who is ollama-benchmarker for?

ollama-benchmarker is an open-source project built for AI researchers and developers.

Does ollama-benchmarker have a free plan?

Yes — ollama-benchmarker is open source under the GPL-3.0-or-later license and free to use.

What platforms does ollama-benchmarker run on?

ollama-benchmarker runs on the web and the command line. It can also be self-hosted.

Is ollama-benchmarker still maintained?

Activity appears to have slowed — PulseGate's most recent liveness signals classify this listing as stale.

What projects are similar to ollama-benchmarker?

Similar projects tracked by PulseGate include ollama-profiler, bench-my-llm, and BenchLoop.

Who makes ollama-benchmarker?

ollama-benchmarker is developed by user (GitHub).

How long has ollama-benchmarker been around?

ollama-benchmarker first shipped in 2026.

Back to the index

ollama-benchmarker

Name: ollama-benchmarker
Author: user (GitHub)

github.comInfrastructure

Comprehensive benchmark suite for Ollama models: LLM, embedding, and reranking evaluation

Open SourceGPL-3.0-or-laterWebCLISelf-hosted

Visit github.com

Overview

5 features

In the LLM evaluation & benchmarks space, ollama-benchmarker takes a focused approach. It focuses on evaluating and benchmarking the performance of Ollama LLM and embedding models efficiently. ollama-benchmarker is an open-source project aimed at AI researchers and developers. The project is open source (GPL-3.0-or-later). It ships for the web and the command line, and it can be self-hosted.

It is developed by user (GitHub), and it first shipped in 2026. Key capabilities include LLM benchmarking, embedding evaluation, and reranking tests.

LLM benchmarking
Embedding evaluation
Reranking tests
MMLU support
MTEB support

Built with & integrations

AI providers

local_oss

Runs on

BrowserCLISelf-hosted

Trust & compliance

License

GPL-3.0-or-later

Verified signals

HTTPSOpen SourceFree tierGitHub

Indexing history

What PulseGate has recorded for this listing

Indexed16 Jun · 00:29 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about ollama-benchmarker

What is ollama-benchmarker?: Ollama-benchmarker focuses on evaluating and benchmarking the performance of Ollama LLM and embedding models efficiently. It is catalogued under LLM evaluation & benchmarks on PulseGate.
Who is ollama-benchmarker for?: ollama-benchmarker is an open-source project built for AI researchers and developers.
Does ollama-benchmarker have a free plan?: Yes — ollama-benchmarker is open source under the GPL-3.0-or-later license and free to use.
What platforms does ollama-benchmarker run on?: ollama-benchmarker runs on the web and the command line. It can also be self-hosted.
Is ollama-benchmarker still maintained?: Activity appears to have slowed — PulseGate's most recent liveness signals classify this listing as stale.
What projects are similar to ollama-benchmarker?: Similar projects tracked by PulseGate include ollama-profiler, bench-my-llm, and BenchLoop.ollama-profiler bench-my-llm BenchLoop
Who makes ollama-benchmarker?: ollama-benchmarker is developed by user (GitHub).
How long has ollama-benchmarker been around?: ollama-benchmarker first shipped in 2026.

At a glance

Platforms: CLI
Languages: English
Open source: Yes (GitHub)
License: GPL-3.0-or-later
Activity: 🟡 Stale
Built for: AI researchers and developers
Model: Open source
Solves: Evaluating and benchmarking the performance of Ollama LLM and embedding models efficiently.

Registered as

GitHub: user/ollama-benchmarker
PyPI: ollama-benchmarker

Developer

user (GitHub)

GitHub

Open source

View on GitHub

Index record

Indexed: 16 Jun 2026
Lifecycle: Dead
Activity: Stale
Last seen: 16 Jun 2026

Identity audit (12)

Slug: ollama-benchmarker-pypi-org
Lifecycle last checked: 17 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 16 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Written by a language model from the project's public pages.
Category from: Recorded source: taxonomy-pass-a.
Summary from: Taken from the package registry entry.
Languages from: Detected by a language model from page content.
Canonical URL: https://github.com/user/ollama-benchmarker

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do