Who is BenchLoop for?

BenchLoop is a B2B product built for AI researchers and developers.

Yes — there is a free tier, with paid plans for advanced use.

What platforms does BenchLoop run on?

BenchLoop runs on the web and the command line.

Is BenchLoop still active?

The GitHub repository shows 19 commits in the last 90 days.

What projects are similar to BenchLoop?

Similar projects tracked by PulseGate include porchbench, BenchLLM, and Localmaxxing.

Is BenchLoop open source?

BenchLoop has a public GitHub repository.

Back to the index

BenchLoop

bench-loop.comLLM eval & observability

BenchLoop is a benchmarking tool for local large language models, providing quality, speed, and reliability scores through both a web app and CLI. It supports various LLM runtimes like Ollama and OpenAI-compatible endpoints, helping developers and researchers evaluate model performance.

FreemiumMITWebCLICloud-managed

Visit bench-loop.com

33stars

6forks

8features

2026since

Overview

8 features

BenchLoop sits in PulseGate's LLM eval & observability category. It focuses on evaluating and comparing the performance of local large language models for developers and researchers. It is built as a B2B product for AI researchers and developers. A free plan is available. It runs on the web and the command line.

BenchLoop first shipped in 2026. Development happens publicly on GitHub with 33 stars and 19 commits in the last 90 days. Among its 8 catalogued features are LLM benchmarking, quality scoring, and speed measurement.

Summary written by a language model from the project’s public pages.

LLM benchmarking
Quality scoring
Speed measurement
Reliability testing
Web interface
CLI tool
Ollama support
OpenAI endpoint support

Built with & integrations

Framework

FastAPI

Hosting

Cloudflare

AI providers

local_oss

Runs on

BrowserCLICloud-managed

Detected from

local_oss: bollama in the HTML · bvllm in the HTML · studio in the HTML
Cloudflare: cf-ray header · cf-cache-status header

Trust & compliance

License

MIT

Verified signals

HTTPSFree tierGitHub · ★ 33Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed17 Jun · 13:31 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about BenchLoop

What does BenchLoop do?: BenchLoop focuses on evaluating and comparing the performance of local large language models for developers and researchers. It is catalogued under LLM eval & observability on PulseGate.
Who is BenchLoop for?: BenchLoop is a B2B product built for AI researchers and developers.
Is BenchLoop free?: Yes — there is a free tier, with paid plans for advanced use.
What platforms does BenchLoop run on?: BenchLoop runs on the web and the command line.
Is BenchLoop still active?: The GitHub repository shows 19 commits in the last 90 days.
What projects are similar to BenchLoop?: Similar projects tracked by PulseGate include porchbench, BenchLLM, and Localmaxxing.porchbench BenchLLM Localmaxxing
How long has BenchLoop been around?: BenchLoop first shipped in 2026.
Is BenchLoop open source?: BenchLoop has a public GitHub repository.

At a glance

Platforms: Cli · Web
Languages: English
Open source: Yes · ★ 33
License: MIT
Built for: AI researchers and developers
Model: B2B
Solves: Evaluating and comparing the performance of local large language models for developers and researchers.

Registered as

GitHub: outsourc-e/bench-loop
PyPI: benchloop-cli

Developer

Outsource

Small team

GitHub

Open source

View on GitHub

Stars: 33
Forks: 6
Open issues: 2
Last commit: 26 May 2026
Commits 90d: 19
Contributors: 2
Authorship: Small team
Default branch: main

Index record

Identity confidence: Medium · 72.8
Indexed: 17 Jun 2026
Lifecycle: Alive
Last seen: 17 Jun 2026

Identity audit (12)

Slug: benchloop-cli-bench-loop-com
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 17 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Derived from the project's own page and URL.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model, checked against the page's own declaration.
Canonical URL: https://bench-loop.com/

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do