PulseGateCategoriesMethodologyCompanyThe global software index— through the gate this hour
Coverage—in the index
Freshness—newest listing
Cadence—last week average · — today
Index9 markets90 categories · 139 niches
PulseGate

The global index of software taking shape now.

Stores show what passed through a store. Launch sites show what launched there. Catalogs show what entered their catalog. Each sees the market through its own gate. PulseGate reads across them.

FollowGitHubX (Twitter)LinkedIn
Platform
IndexIndex by setCategoriesIndustry UpdatesMethodologySupply IndexData SourcesCoverage RulesGlossaryEmbed Widget
Support
Help CenterSubmit your projectReport an Issue
Company
AboutTeamDimaxiaPress & DataContactPlatform Status
Legal
PrivacyTermsDisclaimer
Dimaxia · Dymaxio s.r.o. · Prague, Czechia · © 2026WatchlistSitemapSystem status
PulseGateBEbenchflow
Visit↗
Skip to content
  1. Index›
  2. LLM eval & observability›
  3. benchflow
← Back to the index
BE

benchflow

github.com·Infrastructure

Multi-turn agent benchmarking with ACP — run any agent, any model, any provider.

Open SourceApache-2.0WebCLI
Bbenchflow preview
Visit github.com↗
255stars
32forks
4features
2025since

Overview

4 features

benchflow is a LLM eval & observability project. It focuses on evaluating and benchmarking the performance of multi-turn AI agents across different providers. benchflow is an open-source project aimed at AI researchers and developers. benchflow is open source under the Apache-2.0 license. benchflow is available on the web and the command line.

Behind benchflow is benchflow-ai, and it first shipped in 2025. Development happens publicly on GitHub with 255 stars and 1k commits in the last 90 days. Among its 4 catalogued features are agent benchmarking, multi-provider support, and multi-turn evaluation.

  • ✓Agent benchmarking
  • ✓Multi-provider support
  • ✓Multi-turn evaluation
  • ✓Skill benchmarking
Tags
agent-benchmarkingllm-evaluationmulti-turn
AI capabilities
CodeText
Weights: Open

Built with & integrations

AI providers
anthropicopenai
Runs on
BrowserCLI

Trust & compliance

License
Apache-2.0
Verified signals
✓HTTPS✓Open Source✓Free tier✓GitHub · ★ 255✓Active maintenance

Indexing history

1

What PulseGate has recorded for this listing

  1. Indexed17 Jun · 13:54 UTC
    Listing verified against its public source
    Source: PulseGate · Open ↗

Frequently asked questions about benchflow

What is benchflow?
Benchflow focuses on evaluating and benchmarking the performance of multi-turn AI agents across different providers. It is catalogued under LLM eval & observability on PulseGate.
Who should use benchflow?
benchflow is an open-source project built for AI researchers and developers.
Does benchflow have a free plan?
Yes — benchflow is open source under the Apache-2.0 license and free to use.
What platforms does benchflow run on?
benchflow runs on the web and the command line.
Is benchflow still maintained?
The GitHub repository shows 1k commits in the last 90 days.
What projects are similar to benchflow?
Similar projects tracked by PulseGate include agentbench-cli, benchskills, and benchstats.agentbench-clibenchskillsbenchstatsSee all 18 alternatives
Who develops benchflow?
benchflow is developed by benchflow-ai.
When did benchflow launch?
benchflow first shipped in 2025.

At a glance

Platforms
Cli
Languages
English
Open source
Yes · ★ 255
License
Apache-2.0
Built for
AI researchers and developers
Model
Open source
Solves
Evaluating and benchmarking the performance of multi-turn AI agents across different providers.

Registered as

GitHub
benchflow-ai/benchflow
PyPI
benchflow

Developer

benchflow-ai
Team
↗ GitHub

Open source

View on GitHub →
Stars
255
Forks
32
Open issues
27
Last commit
17 Jun 2026
Commits 90d
1,046
Contributors
17
Authorship
Team
Default branch
main
Latest release
v0.6.3 · 16 Jun 2026

Index record

Identity confidence
Medium · 70
Indexed
17 Jun 2026
Lifecycle
Alive
Last seen
17 Jun 2026
Identity audit (12)
Slug
benchflow-pypi-org
Lifecycle last checked
8 Aug 2026
Verification state
Indexed for public listing
Listing state
Listed: yes
Index status
Included in index
Latest evidence snapshot
17 Jun 2026
Timeline basis
Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from
Written by a language model from the project's public pages.
Category from
Assigned by a language model.
Summary from
Taken from the package registry entry.
Languages from
Detected by a language model from page content.
Canonical URL
https://github.com/benchflow-ai/benchflow

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do

  • AGagentbench-clipypi.org
  • BEbenchskillspypi.org
  • BEbenchstatsgithub.com
  • LIlitebenchgithub.com
  • LLllm-agent-benchpypi.org
  • BEbenchstonegithub.com

See 18 alternatives to benchflow →