Skip to content
Back to the index

probity-evals

PyPIInfrastructure

PulseGate's liveness check found it on 26 Sep 2026; it is registered on PyPI and has been in the index since 26 Sep 2026. How this is checked

Probity Evals is an MIT-licensed open-source Python package for testing and evaluating MCP servers, A2A agents, and agent skills. It is intended for developers who need automated evaluation workflows for agent-based systems.

Inferred · not functionally tested

Open SourceMITCLISelf-hosted
Visit PyPI
3alternatives
4features
2026since

Overview

4 features

Purpose: Testing and evaluating MCP servers, A2A agents, and agent skills for reliability and correctness.

Inferred · not functionally tested

Audience: AI agent developers and maintainers

Inferred · not functionally tested

Functions: agents

Inferred · not functionally tested

Interfaces: API: unknown · MCP: indicated (inferred, not tested) · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)

Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: cli, self_hosted

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: pypi.org. These links do not verify the individual claims.

probity-evals is an Agent evaluation & testing project. Inferred · not functionally tested: probity-evals is an open-source project aimed at AI agent developers and maintainers. Basis unknown · not verified: The project is open source (MIT). Basis unknown · not verified: It ships for the command line, and it can be self-hosted.

Probity builds and maintains probity-evals, and it first shipped in 2026. Inferred · not functionally tested: Among its 4 catalogued features are MCP testing, A2A evaluation, and agent skill testing. Basis unknown · not verified: Catalogued interfaces include an MCP server.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • MCP testing
  • A2A evaluation
  • Agent skill testing
  • Automated evaluations

Topics: Inferred · not functionally tested

Tags
mcp-testingagent-evaluationa2a-agentsagent-skills

JSON profile · Text profile · Access guide

Built with & integrations

Connectors
MCP
Runs on
CLISelf-hosted

Trust & compliance

License
MIT
Public signals
HTTPSOpen Source

Indexing history

1

What PulseGate has recorded for this listing

  1. Indexed26 Sep · 09:26 UTC
    probity-evals seen via PyPI Bulk Enumerator
    Source: PyPI Bulk Enumerator · Open

Frequently asked questions about probity-evals

What is probity-evals?
Inferred · not functionally tested: Probity-evals focuses on testing and evaluating MCP servers, A2A agents, and agent skills for reliability and correctness. It is catalogued under Agent evaluation & testing on PulseGate.
Who should use probity-evals?
Inferred · not functionally tested: probity-evals is an open-source project built for AI agent developers and maintainers.
Does probity-evals have a free plan?
Basis unknown · not verified: Yes — probity-evals is open source under the MIT license and free to use.
What platforms does probity-evals run on?
Basis unknown · not verified: probity-evals runs on the command line. It can also be self-hosted.
Is probity-evals still active?
PulseGate's liveness check found it on 26 Sep 2026.
What projects are similar to probity-evals?
Similar projects tracked by PulseGate include probityai-pro, probityai, and probity-mcp.probityai-proprobityaiprobity-mcp
Who makes probity-evals?
probity-evals is developed by Probity.
How long has probity-evals been around?
probity-evals first shipped in 2026.

Similar projects

Closest matches by what these projects do