MCPMark
MCPMark is an open benchmark for stress-testing AI models and agents on verifiable tasks performed through Model Context Protocol servers. It includes version-pinned evaluation tasks, leaderboards, documentation, and an explorer for comparing results across models.
Overview
8 featuresMCPMark is an Agent evaluation & testing project. It focuses on evaluating whether AI models and agents can reliably complete diverse real-world tasks through MCP servers. It is built as an open-source project for AI researchers and developers evaluating models, agents, and MCP servers. The project is open source (Apache-2.0). It runs on the web and the command line, and it can be self-hosted.
EVAL SYS NUS TRAIL builds and maintains MCPMark, and it first shipped in 2025. The project is developed in the open on GitHub with 460 stars and 2 commits in the last 90 days. Among its 8 catalogued features are Benchmark Tasks, Model Leaderboard, and Verified Tasks. It exposes integrations via an MCP server.
Summary written by a language model from the project’s public pages.
- Benchmark Tasks
- Model Leaderboard
- Verified Tasks
- Task Explorer
- MCP Server Testing
- Reproducible Evaluation
- Task Contributions
- Documentation
Built with & integrations
- Next.js
- x-nextjs-prerender header · x-powered-by header · /_next/static/ in the HTML
- Vercel
- x-vercel-id header · x-vercel-cache header
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed2 Sept · 20:32 UTCeval-sys/mcpmark verified against its public sourceSource: PulseGate · Open
Frequently asked questions about MCPMark
- What is MCPMark?
- MCPMark focuses on evaluating whether AI models and agents can reliably complete diverse real-world tasks through MCP servers. It is catalogued under Agent evaluation & testing on PulseGate.
- Who should use MCPMark?
- MCPMark is an open-source project built for AI researchers and developers evaluating models, agents, and MCP servers.
- Is MCPMark free?
- Yes — MCPMark is open source under the Apache-2.0 license and free to use.
- What platforms does MCPMark run on?
- MCPMark runs on the web and the command line. It can also be self-hosted.
- Is MCPMark still active?
- The GitHub repository shows 2 commits in the last 90 days.
- What projects are similar to MCPMark?
- Similar projects tracked by PulseGate include MCP endpoint, mcp, and MCP Manager.MCP endpointmcpMCP Manager
- Who develops MCPMark?
- MCPMark is developed by EVAL SYS NUS TRAIL, based in Singapore.
- When did MCPMark launch?
- MCPMark first shipped in 2025.
Similar projects
Closest matches by what these projects do