What does agent-eval do?

Agent-eval provides tools for evaluating the performance and behavior of AI agents. It is catalogued under AI on PulseGate.

Who should use agent-eval?

agent-eval is an open-source project built for AI researchers and developers.

What platforms does agent-eval run on?

agent-eval runs on the web and the command line. It can also be self-hosted.

Is agent-eval still active?

Unverified. agent-eval has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.

What projects are similar to agent-eval?

Similar projects tracked by PulseGate include AgentEval, ai-eval-forge, and evalite.

Back to the index

agent-eval

PyPIInfrastructure

Agent evaluation toolkit

Open SourceWebCLISelf-hosted

Visit PyPI

Overview

3 features

agent-eval sits in PulseGate's AI category. It provides tools for evaluating the performance and behavior of AI agents. agent-eval is an open-source project aimed at AI researchers and developers. agent-eval is open source under the Open Source license. agent-eval is available on the web and the command line, and it can be self-hosted.

agent-eval first shipped in 2025. Key capabilities include agent evaluation, toolkit, and CLI support.

Agent evaluation
Toolkit
CLI support

Built with & integrations

Runs on

BrowserCLISelf-hosted

Trust & compliance

License

Open Source

Verified signals

HTTPSOpen SourceFree tier

Indexing history

What PulseGate has recorded for this listing

Indexed17 Jun · 11:54 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about agent-eval

What does agent-eval do?: Agent-eval provides tools for evaluating the performance and behavior of AI agents. It is catalogued under AI on PulseGate.
Who should use agent-eval?: agent-eval is an open-source project built for AI researchers and developers.
Does agent-eval have a free plan?: Yes — agent-eval is open source under the Open Source license and free to use.
What platforms does agent-eval run on?: agent-eval runs on the web and the command line. It can also be self-hosted.
Is agent-eval still active?: Unverified. agent-eval has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
What projects are similar to agent-eval?: Similar projects tracked by PulseGate include AgentEval, ai-eval-forge, and evalite.AgentEval ai-eval-forge evalite See all 35 alternatives
When did agent-eval launch?: agent-eval first shipped in 2025.
Is agent-eval open source?: Yes — agent-eval is open source under the Open Source license.

At a glance

Platforms: Cli
Languages: English
License: Open Source
Built for: AI researchers and developers
Model: Open source
Solves: Provides tools for evaluating the performance and behavior of AI agents.

Registered as

PyPI: agent-eval

Developer

Pypi

Index record

Identity confidence: Medium · 70
Indexed: 17 Jun 2026
Lifecycle: Alive
Last seen: 17 Jun 2026

Identity audit (12)

Slug: agent-eval-pypi-org
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 17 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Taken from the package registry entry.
Languages from: Detected by a language model from page content.
Canonical URL: https://pypi.org/project/agent-eval

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do

See 35 alternatives to agent-eval