Agent Eval Planner
PulseGate's liveness check found it on 8 Sep 2026; it is registered on GitHub and has been in the index since 26 Aug 2026. How this is checked
Agent Eval Planner is a Ruby command-line tool that reads an agent contract and produces a structured evaluation pack. It generates attack prompts with pass/fail criteria, executable JSONL cases, and remediation guidance for prompt, policy-gate, and evaluator layers.
Overview
10 featuresAgent Eval Planner sits in PulseGate's Agent evaluation & testing category. It focuses on testing AI agents for scope violations, prompt injection, unsafe tool use, and other guardrail failures. Agent Eval Planner is an open-source project aimed at AI engineering and application security teams. The project is open source (MIT). It ships for the web and the command line, and it can be self-hosted.
Behind Agent Eval Planner is Saulo Filho, and it first shipped in 2026. The project is developed in the open on GitHub with 4 commits in the last 90 days. Among its 10 catalogued features are contract analysis, attack prompts, and pass/fail criteria.
Summary written by a language model from the project’s public pages.
- Contract analysis
- Attack prompts
- Pass/fail criteria
- JSONL suites
- Remediation guidance
- Severity ranking
- Stable vector IDs
- Scope testing
- Prompt injection tests
- Tool abuse tests
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed26 Aug · 18:36 UTCagent_eval_planner verified via RubyGems newly publishedSource: RubyGems newly published · Open
Frequently asked questions about Agent Eval Planner
- What does Agent Eval Planner do?
- Agent Eval Planner focuses on testing AI agents for scope violations, prompt injection, unsafe tool use, and other guardrail failures. It is catalogued under Agent evaluation & testing on PulseGate.
- Who is Agent Eval Planner for?
- Agent Eval Planner is an open-source project built for AI engineering and application security teams.
- Does Agent Eval Planner have a free plan?
- Yes — Agent Eval Planner is open source under the MIT license and free to use.
- What platforms does Agent Eval Planner run on?
- Agent Eval Planner runs on the web and the command line. It can also be self-hosted.
- Is Agent Eval Planner still active?
- PulseGate's liveness check found it on 8 Sep 2026. Its GitHub repository shows 4 commits in the last 90 days.
- What projects are similar to Agent Eval Planner?
- Similar projects tracked by PulseGate include AgentEval, agent-eval, and agentsec-eval.AgentEvalagent-evalagentsec-eval
- Who makes Agent Eval Planner?
- Agent Eval Planner is developed by Saulo Filho.
- How long has Agent Eval Planner been around?
- Agent Eval Planner first shipped in 2026.
Similar projects
Closest matches by what these projects do