Skip to content
Back to the index

AgentEval

agenteval.devInfrastructure

PulseGate's liveness check found it on 13 Sep 2026; it is registered on GitHub and has been in the index since 26 Jun 2026. How this is checked

AI. NET ecosystem.

Inferred · not functionally tested

Open SourceMITCLIAPI
AgentEval preview
Visit agenteval.dev
124stars
10forks
1alternative
5features
2026since

Overview

5 features

Purpose: Evaluating and benchmarking the performance and reliability of AI agents in .NET environments.

Inferred · not functionally tested

Audience: .NET developers

Inferred · not functionally tested

Functions: analytics, monitoring

Inferred · not functionally tested

Interfaces: API: indicated (inferred, not tested) · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: unknown

Recorded constraints: pricing: open_source · license: MIT · platforms: API, CLI · deployment: cli, api_only

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: agenteval.dev · github.com. These links do not verify the individual claims.

AgentEval sits in PulseGate's Agent evaluation & testing category. Inferred · not functionally tested: It focuses on evaluating and benchmarking the performance and reliability of AI agents in .NET environments. Inferred · not functionally tested: It is built as an open-source project for .NET developers. Basis unknown · not verified: The project is open source (MIT). Basis unknown · not verified: It runs on the command line and API.

AgentEval first shipped in 2026. Development happens publicly on GitHub with 124 stars and 38 commits in the last 90 days. Inferred · not functionally tested: Among its 5 catalogued features are tool usage validation, RAG quality metrics, and stochastic evaluation.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Tool usage validation
  • RAG quality metrics
  • Stochastic evaluation
  • Model comparison
  • Memory benchmarks

Topics: Inferred · not functionally tested

Tags
agent-evaluationrag-metricsdotnet-toolkitai-benchmarking
AI capabilities
CodeStructured

JSON profile · Text profile · Access guide

Built with & integrations

AI providers
openai
Runs on
CLIAPI-only
Detected from
openai
bgpt- in the HTML

Trust & compliance

License
MIT
Public signals
HTTPSOpen SourceFree tierGitHub · ★ 124Active maintenance

Indexing history

What PulseGate has recorded for this listing

Nothing recorded for this listing in this window.

Frequently asked questions about AgentEval

What is AgentEval?
Inferred · not functionally tested: AgentEval focuses on evaluating and benchmarking the performance and reliability of AI agents in .NET environments. It is catalogued under Agent evaluation & testing on PulseGate.
Who should use AgentEval?
Inferred · not functionally tested: AgentEval is an open-source project built for .NET developers.
Does AgentEval have a free plan?
Basis unknown · not verified: Yes — AgentEval is open source under the MIT license and free to use.
What platforms does AgentEval run on?
Basis unknown · not verified: AgentEval runs on the command line and API.
Is AgentEval still maintained?
PulseGate's liveness check found it on 13 Sep 2026. Its GitHub repository shows 38 commits in the last 90 days.
What are alternatives to AgentEval?
Similar projects tracked by PulseGate include agent-eval, AgentEvals, and agent-evaluation-lab.agent-evalAgentEvalsagent-evaluation-lab
How long has AgentEval been around?
AgentEval first shipped in 2026.
Is AgentEval open source?
Basis unknown · not verified: Yes — AgentEval is open source under the MIT license, developed on GitHub.

Similar projects

Closest matches by what these projects do