Iris Eval MCP Server
PulseGate's liveness check found it on 8 Oct 2026; it has been in the index since 3 Sep 2026. How this is checked
Iris Eval MCP Server provides an evaluation standard and server for MCP-based agents. It helps developers score output quality, detect safety failures, and enforce cost budgets through CLI and programmatic workflows.
Inferred · not functionally tested
Overview
6 featuresPurpose: Evaluating MCP agents consistently for quality, safety, and cost before they reach users.
Inferred · not functionally tested
Audience: AI and MCP developers
Inferred · not functionally tested
Functions: analytics, monitoring
Inferred · not functionally tested
Interfaces: API: indicated (inferred, not tested) · MCP: indicated (inferred, not tested) · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)
Recorded constraints: pricing: open_source · license: Open Source · platforms: API, CLI · deployment: cli, api_only, self_hosted
Constraint provenance is unknown; confirm requirements with the publisher.
Record sources: github.com. These links do not verify the individual claims.
Iris Eval MCP Server sits in PulseGate's Agent evaluation & testing category. Inferred · not functionally tested: It focuses on evaluating MCP agents consistently for quality, safety, and cost before they reach users. Inferred · not functionally tested: Iris Eval MCP Server is an open-source project aimed at AI and MCP developers. Basis unknown · not verified: The project is open source (Open Source). Basis unknown · not verified: It ships for the command line and API, and it can be self-hosted.
It is developed by iris-eval. Inferred · not functionally tested: Key capabilities include output scoring, safety checks, and cost budgets. Inferred · not functionally tested: Catalogued interfaces include an MCP server.
Summary written by a language model from the project’s public pages.
Tasks: Inferred · not functionally tested
- Output scoring
- Safety checks
- Cost budgets
- MCP server
- Agent evaluation
- CLI workflow
Topics: Inferred · not functionally tested
Built with & integrations
- multiple
- bLangChain in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed3 Sep · 12:32 UTCio.github.iris-eval/mcp-server seen via MCP Registry (official)Source: MCP Registry (official) · Open
Frequently asked questions about Iris Eval MCP Server
- What is Iris Eval MCP Server?
- Inferred · not functionally tested: Iris Eval MCP Server focuses on evaluating MCP agents consistently for quality, safety, and cost before they reach users. It is catalogued under Agent evaluation & testing on PulseGate.
- Who is Iris Eval MCP Server for?
- Inferred · not functionally tested: Iris Eval MCP Server is an open-source project built for AI and MCP developers.
- Does Iris Eval MCP Server have a free plan?
- Basis unknown · not verified: Yes — Iris Eval MCP Server is open source under the Open Source license and free to use.
- What platforms does Iris Eval MCP Server run on?
- Basis unknown · not verified: Iris Eval MCP Server runs on the command line and API. It can also be self-hosted.
- Is Iris Eval MCP Server still active?
- PulseGate's liveness check found it on 8 Oct 2026.
- What are alternatives to Iris Eval MCP Server?
- Similar projects tracked by PulseGate include evals-mcp-server, iris-security-mcp, and ictexam-mcp.evals-mcp-serveriris-security-mcpictexam-mcp
- Who develops Iris Eval MCP Server?
- Iris Eval MCP Server is developed by iris-eval.
- Is Iris Eval MCP Server open source?
- Basis unknown · not verified: Yes — Iris Eval MCP Server is open source under the Open Source license.
Similar projects
Closest matches by what these projects do