AI-native quality gate for agent-generated code — scan, audit, auto-fix, trend Below are 39 llm eval & observability apps with similar functionality to agentguard-tool, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
ai-agentguard is an open-source CLI tool that monitors AI coding agents for security threats such as remote code execution, MCP poisoning, and API key theft. It is designed for developers working with AI agent frameworks to enhance security.
agentguardCI is an open-source command-line tool that provides contract testing for tool-using AI agents. It integrates with CI pipelines to automatically evaluate and validate agent behaviors, helping developers ensure reliability and correctness of their AI systems.
Unified CLI for the Agent Quality Toolkit (agentmd, coderace, agentlint, agentreflect)
CLI-Toolkit für AI-Agent-Infrastruktur: .agent-Ordner, Tool-Discovery, Credential-Management
agentic-guard is an open-source static analysis tool that scans LLM agent code for prompt injection and confused-deputy vulnerabilities. It helps AI developers and security engineers ensure the safety of agentic software.
agent-audit-kit is an open-source CLI tool that scans MCP-connected AI agent pipelines for security vulnerabilities. It helps AI security engineers ensure the safety and compliance of agent-based workflows.
agentlint is an open-source CLI tool that provides real-time quality guardrails and linting for AI coding agents. It helps developers maintain code quality and safety by integrating with agentic coding workflows and enforcing best practices.
Policy-as-code runtime for AI agents — audit log + hard-no enforcement.
AgentGuard is an open-source desktop and CLI tool that provides local guardrails for AI coding agents. It blocks secrets, protects dependencies, compresses shell and context output, and offers logs and analytics. Designed for developers seeking to secure and optimize AI agent workflows.
Raises the cost of prompt injection attacks against AI coding agents
Autonomous Offensive Security Intelligence - AI-powered penetration testing
agentaudit-scanner is an open-source CLI tool that scans AI agent skills, rule files, and MCP configurations for security risks like prompt injections and hidden instructions. It is designed for AI security engineers and developers to ensure safe agent deployments.
security-agent is an open-source CLI tool designed for Ruby on Rails developers to locally triage and analyze dependency vulnerabilities. It helps streamline security workflows by providing fast, local analysis of project dependencies.
A suite of AI-powered command-line tools for text correction, audio transcription, and voice assistance.
Diagnose why your LLM agent failed. Deterministic causal analysis with fix generation.
OWASP Guard CLI: secure code inspector
Security harness for AI coding agents (Claude Code, Codex CLI, etc.) — mitmproxy payload inspection + TOML policy control.
commitguard-cli is an open-source command-line tool that uses AI models to analyze Git commits for bugs and issues. It integrates with Git workflows to provide automated code review and quality checks, supporting developers in maintaining code quality.
AgentGuard is an infrastructure tool for runtime governance, compliance, and security of production AI agents. It integrates with popular AI frameworks and provides audit logging, policy enforcement, and regulatory compliance features for organizations deploying autonomous agents.
AgentGuard is an open-source MCP server that provides quality assurance for AI-generated code. It offers archetype templates, structural validation, and self-challenge mechanisms to ensure production-ready code from agents like Claude or GPT. Designed for AI developers and QA teams.
agentsentinel-cli is an open-source command-line tool that provides security scanning, static analysis, supply chain auditing, and multi-agent trust analysis for AI agents and MCP servers. It helps developers and security engineers identify vulnerabilities and ensure compliance with security best practices in agentic systems.
Pick the right tools for an agent task. Boring baseline. Open dataset.
Evaluation harness for real headless CLI agents - reproducible multi-turn scenarios, rule + LLM scoring, cross-agent comparison
Language-agnostic correctness checker for scientific numerical code
Lighthouse for AI agent development environments
Agent discovery tool for networks
agentproof-scan is an open-source CLI security scanner designed to probe AI-agent HTTP endpoints for secret and prompt leakage. It integrates with CI pipelines using exit codes to automate security checks, helping developers and security engineers ensure their AI agents are not exposing sensitive information.
supervisor-guards is an open-source CLI tool that wraps unsafe agent actions with guardrails, providing runtime supervision and policy enforcement. It is designed for AI agent developers who need to ensure safe and controlled agent behavior.
agentsec-cli is an open-source CLI tool that performs static security analysis on AI coding agents and Model Context Protocol (MCP) configurations. It helps developers and security teams identify vulnerabilities and misconfigurations in agent-based AI systems before deployment.
agchk is an open-source CLI tool that audits the architecture and health of AI agent systems and LLM-integrated projects. It helps developers and auditors ensure the security and robustness of their AI deployments.
Self-describing local inbox for coding agents
Score any URL for AI-agent readiness — llms.txt, JSON-LD, AI-bot robots.txt, canonical, MCP, meta, sitemap.
contractguardian is an open-source CLI tool that uses AI to scan contracts for red flags, unfair terms, and missing protections. It helps legal professionals and developers automate contract review and improve legal compliance.
Evidence-first, artifact-driven bug triage workflow for CLI agents
Agent tools in Python (web, files, terminal, browser, memory, cron, and more).
Offline AI agent bill of materials and attack surface scanner
Detect if code is running in an AI agent or automated development environment
agentsec-eval is an open-source CLI framework for evaluating the security of AI agents. It provides adversarial test runners, server-side audits, and scoring mechanisms to help researchers and developers identify vulnerabilities such as prompt injection and improve agent robustness.
TUI inspector for agent CLI configuration directories like ~/.claude/.
