PulseGatePost-LLM software, agents & workflows market (since 2022)
Coverage
166,100

Apps indexed

 

Freshness
41 min ago

Last update

 

Cadence
1,403/day

7-day average

Indexed today: 357

PulseGate

Market catalog for public software products, models, infra, and workflow tools.

Software is shipping faster than ever, and a growing share of it lives outside the official app stores. PulseGate is a free public catalog — built for builders, analysts, and everyday users.

Platform

  • All Apps
  • Categories
  • Industry Updates
  • Data Sources
  • Coverage Rules
  • Glossary
  • Embed Widget

Support

  • Help Center
  • Submit a Project
  • Report an Issue

Company

  • About
  • Press & Data
  • Contact
  • Platform Status

Legal

  • Privacy
  • Terms
  • Disclaimer

© 2026 PulseGate. Operated by Dymaxio s.r.o., Prague, Czech Republic.·

All systems operational
PulseGate
CO
coder-eval
Visit ↗
  1. Home/
  2. LLM eval & observability/
  3. coder-eval
←Back to results
C

coder-eval

pypi.org·Infrastructure

coder-eval is an open-source command-line tool for evaluating, benchmarking, and A/B testing AI coding agents. It uses sandboxed, reproducible YAML task suites, making it suitable for AI researchers and developers assessing agent performance.

Open SourceApache-2.0
CLISelf-hosted
C
Visit PyPI↗
⭐2
stars
✓5
features
📅2026
since

Overview

5 features
  • ✓Agent evaluation
  • ✓Benchmarking
  • ✓A/B testing
  • ✓YAML task suites
  • ✓Sandboxed execution

Tags

agent-evaluationcode-benchmarkingab-testing

AI capabilities

Code

Built with & integrations

AI providers
anthropic
Runs on
CLISelf-hosted

Trust & compliance

LicenseApache-2.0
Verified signals
✓ HTTPS✓ Open Source✓ Free tier✓ GitHub · ★ 2✓ Active maintenance

Recent events

Latest indexed changes and source events

  1. IndexedJul 9, 11:04 AM

    coder-eval discovered by the PulseGate indexer

    Source: PulseGate indexerOpen ↗

At a glance

Platforms
Cli
Languages
English
Open source
Yes · ★ 2
License
Apache-2.0
First seen
Jul 9, 2026
Activity
🟢 Active
Status
🟢 Active
Built for
AI researchers
Model
Open source
Solves
Providing reproducible evaluation and benchmarking of AI coding agents using standardized task suites.

Developer

UiPath
Solo developer
↗ GitHub

Open source

View on GitHub →
⭐ Stars
2
🍴 Forks
0
Open issues
5
Last commit
2d ago
Commits 90d
5
Contributors
1
Authorship
Solo
Default branch
main

PulseGate index

Confidence
Low · 64
Indexed
Jul 9, 2026
Lifecycle
Alive
Activity
Active
First seen
Jul 2026
Last seen
2d ago
Freshness
Unknown
Identity audit (9)
Entity ID
cmrdegrkw0ll6h84qv32kr7jf
Slug
coder-eval-pypi-org
Verification state
Indexed for public listing
Claim / listing state
Unclaimed · listed: yes
Index status
Included in index
Latest evidence snapshot
Jul 9, 2026
Timeline basis
Indexed-at chronology (no inferred launch/funding milestones).
Last updated
Jul 9, 2026
Canonical URL
https://pypi.org/project/coder-eval

Similar apps

Other apps tracked under the same category.

  • caliper-eval
    pypi.org
  • ai01-eval
    github.com
  • leanlab
    pypi.org
  • agent-skill-eval
    pypi.org
  • agent-eval
    pypi.org
  • tool-eval
    github.com

See 10 alternatives to coder-eval