PulseGateLive intelligence on AI-era software
Coverage
175,547

Software tracked

 

Freshness
16 min ago

Last update

 

Cadence
485/day

7-day average

Indexed today: 813

PulseGate

Live intelligence on the software shipping in the AI era — apps, models, agents, and infra.

Software is shipping faster than ever, and a growing share of it lives outside the official app stores. PulseGate tracks it live — free, for builders, analysts, and everyone keeping up.

Follow
GitHubX (Twitter)LinkedIn

Platform

  • All Apps
  • Full Index
  • Categories
  • Industry Updates
  • Data Sources
  • Coverage Rules
  • Glossary
  • Embed Widget

Support

  • Help Center
  • Suggest a URL
  • Report an Issue

Company

  • About
  • Dimaxia
  • Press & Data
  • Contact
  • Platform Status

Legal

  • Privacy
  • Terms
  • Disclaimer

© 2026 PulseGate. Operated by Dimaxia, a brand of Dymaxio s.r.o., Prague, Czech Republic.·

All systems operational
PulseGate
CR
crowdbench-run
Visit ↗
  1. Home/
  2. LLM eval & observability/
  3. crowdbench-run
←Back to results
C

crowdbench-run

PyPI·Infrastructure

crowdbench-run is an open-source command-line tool designed to execute ephemeral, hash-pinned intelligence benchmarks using the CrowdBench platform. It enables AI researchers and developers to run reproducible evaluation workflows efficiently. The tool is suitable for those needing automated, consistent benchmarking in AI projects.

Open SourceApache-2.0
WebCLI
C
crowdbench-run preview
Visit PyPI↗

Overview

5 features

crowdbench-run is a LLM eval & observability product. It focuses on running reproducible and ephemeral intelligence benchmarks for AI evaluation workflows. crowdbench-run is an open-source project aimed at AI researchers and developers. The project is open source (Apache-2.0). The product ships for the web and the command line.

crowdbench-run first shipped in 2026. Among its 5 catalogued features are benchmark runner, ephemeral runs, and hash-pinned execution.

  • ✓Benchmark runner
  • ✓Ephemeral runs
  • ✓Hash-pinned execution
  • ✓CrowdBench integration
  • ✓Command-line interface

Tags

benchmarkingai-evaluationcli-toolreproducibility

Built with & integrations

Runs on
BrowserCLI

Trust & compliance

LicenseApache-2.0
Verified signals
✓ HTTPS✓ Open Source✓ Free tier

Recent events

Latest indexed changes and source events

  1. IndexedJul 18, 11:55 AM

    crowdbench-run verified by the PulseGate indexer

    Source: PulseGate indexerOpen ↗

Frequently asked questions about crowdbench-run

What is crowdbench-run?
Crowdbench-run focuses on running reproducible and ephemeral intelligence benchmarks for AI evaluation workflows. It is catalogued under LLM eval & observability on PulseGate.
Who should use crowdbench-run?
crowdbench-run is an open-source project built for AI researchers and developers.
Does crowdbench-run have a free plan?
Yes — crowdbench-run is open source under the Apache-2.0 license and free to use.
What platforms does crowdbench-run run on?
crowdbench-run runs on the web and the command line.
Is crowdbench-run still active?
PulseGate's liveness checks currently classify crowdbench-run as active.
What tools are similar to crowdbench-run?
Similar tools tracked by PulseGate include benchcaddy, benchflow, and cis-bench.benchcaddybenchflowcis-bench
How long has crowdbench-run been around?
crowdbench-run first shipped in 2026.
Is crowdbench-run open source?
Yes — crowdbench-run is open source under the Apache-2.0 license.

At a glance

Platforms
Cli · Web
Languages
English
License
Apache-2.0
First seen
Jul 18, 2026
Activity
🟢 Active
Status
🟢 Active
Built for
AI researchers and developers
Model
Open source
Solves
Running reproducible and ephemeral intelligence benchmarks for AI evaluation workflows.

Developer

Pypi

Live coverage

Confidence
Low · 64
Indexed
Jul 18, 2026
Lifecycle
Alive
Activity
Active
First seen
Jul 2026
Last seen
3d ago
Identity audit (9)
Entity ID
cmrqb8hdl000m13mha9vrzgr9
Slug
crowdbench-run-pypi-org
Verification state
Indexed for public listing
Claim / listing state
Unclaimed · listed: yes
Index status
Included in index
Latest evidence snapshot
Jul 18, 2026
Timeline basis
Indexed-at chronology (no inferred launch/funding milestones).
Last updated
Jul 21, 2026
Canonical URL
https://crowdbench.ai

Similar apps

Other apps tracked under the same category.

  • benchcaddy
    github.com
  • benchflow
    github.com
  • cis-bench
    github.com
  • benchdiff
    pypi.org
  • quantum-backend-bench
    pypi.org
  • llm-benchmark-runner
    github.com