mendmark-evals
Mendmark-evals is a Python package for performing mutation testing on evaluation suites used for LLM-based agents. It helps developers assess how well their test frameworks detect failures and measure the quality of autonomous agent implementations.
Open SourceMITCLI
Overview
3 featuresmendmark-evals sits in PulseGate's LLM eval & observability category. It focuses on evaluating the robustness and reliability of AI agent testing frameworks. It is built as an open-source project for AI developers. The project is open source (MIT). It ships for the command line.
It is developed by Daniel Gaskins, and it first shipped in 2026. Development happens publicly on GitHub with 14 commits in the last 90 days. Key capabilities include mutation testing, agent evaluation, and test suite analysis.
Summary written by a language model from the project’s public pages.
- Mutation testing
- Agent evaluation
- Test suite analysis
Tags
mutation-testingagent-evaluationllm-testingeval-framework
Built with & integrations
Runs on
CLI
Trust & compliance
License
MIT
Verified signals
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about mendmark-evals
- What does mendmark-evals do?
- Mendmark-evals focuses on evaluating the robustness and reliability of AI agent testing frameworks. It is catalogued under LLM eval & observability on PulseGate.
- Who is mendmark-evals for?
- mendmark-evals is an open-source project built for AI developers.
- Does mendmark-evals have a free plan?
- Yes — mendmark-evals is open source under the MIT license and free to use.
- What platforms does mendmark-evals run on?
- mendmark-evals runs on the command line.
- Is mendmark-evals still maintained?
- The GitHub repository shows 14 commits in the last 90 days.
- What are alternatives to mendmark-evals?
- Similar projects tracked by PulseGate include ase-python, constraintloop, and OpenCode Data.ase-pythonconstraintloopOpenCode Data
- Who develops mendmark-evals?
- mendmark-evals is developed by Daniel Gaskins.
- When did mendmark-evals launch?
- mendmark-evals first shipped in 2026.
Also in LLM eval & observability
Same category — not a similarity match