agent-eval-contract is an open-source package providing Pydantic contracts and JSON Schemas for creating and validating portable agent evaluation records. It is designed for AI researchers and developers working on agent evaluation and benchmarking.
agent-eval-contract is a LLM eval & observability product. It focuses on standardizing and validating agent evaluation records for AI evaluation workflows. agent-eval-contract is an open-source project aimed at AI researchers. The project is open source (MIT). The product ships for the command line.
agent-eval-contract first shipped in 2026. Among its 5 catalogued features are pydantic contracts, JSON Schema generation, and agent evaluation records.
Latest indexed changes and source events
agent-eval-contract verified by the PulseGate indexer
Other apps tracked under the same category.