agentscanner is an open-source CLI tool that performs static security analysis on agentic AI configuration files, including settings, permissions, hooks, and MCP servers. Below are 15 llm eval & observability apps with similar functionality to agentscanner, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
agentsec-cli is an open-source CLI tool that performs static security analysis on AI coding agents and Model Context Protocol (MCP) configurations. It helps developers and security teams identify vulnerabilities and misconfigurations in agent-based AI systems before deployment.
agentaudit-scanner is an open-source CLI tool that scans AI agent skills, rule files, and MCP configurations for security risks like prompt injections and hidden instructions. It is designed for AI security engineers and developers to ensure safe agent deployments.
ai-agentic-mcpscan is an open-source command-line tool that provides local-first, offline-by-default security posture scanning for Model Context Protocol (MCP) and local-agent environments. It is intended for security engineers and teams managing agent-based infrastructures.
agentsentinel-cli is an open-source command-line tool that provides security scanning, static analysis, supply chain auditing, and multi-agent trust analysis for AI agents and MCP servers. It helps developers and security engineers identify vulnerabilities and ensure compliance with security best practices in agentic systems.
agentproof-scan is an open-source CLI security scanner designed to probe AI-agent HTTP endpoints for secret and prompt leakage. It integrates with CI pipelines using exit codes to automate security checks, helping developers and security engineers ensure their AI agents are not exposing sensitive information.
agent-skill-scanner is an open-source CLI tool that scans agent skill files for security vulnerabilities, including prompt injection, capability escalation, and data exfiltration. It applies 22 security rules to help AI developers and security researchers identify and mitigate risks in LLM agent skills. The tool is MIT licensed and suitable for anyone building or auditing AI agent systems.
agent-squad is an open-source Python framework for creating, orchestrating, and managing squads of autonomous AI agents. It provides a CLI interface and is designed for developers and researchers building complex agent-based systems. The project is licensed under Apache 2.0 and available on GitHub.
agent-audit-kit is an open-source CLI tool that scans MCP-connected AI agent pipelines for security vulnerabilities. It helps AI security engineers ensure the safety and compliance of agent-based workflows.
CLI tool for deploying and managing AI coding agent configurations (MCP servers, skills, instructions) across multiple providers.
AgentAz Compliance Scanner is a web-based tool that analyzes AI agent system prompts or agentaz.json files for compliance with Microsoft's agent-governance guidance. It provides deterministic, automated checks, risk analysis, and actionable fixes for AI developers and teams.
reaper-scanner is an open-source command-line tool designed to scan AI agents for security vulnerabilities. It helps AI security engineers identify and mitigate risks in agent-based systems and pipelines.
Zero-config, fully local static security analyzer for AI agents
agentsecure is an open-source CLI tool that provides a local-first security runtime for AI coding agents. It enables developers to securely execute AI agents in sandboxed environments, ensuring safe and controlled code execution.
agentdef is an open-source CLI tool and specification for defining AI agents in a portable, framework-agnostic way. It enables developers to standardize agent definitions and streamline deployment across different AI frameworks.
agentsec-eval is an open-source CLI framework for evaluating the security of AI agents. It provides adversarial test runners, server-side audits, and scoring mechanisms to help researchers and developers identify vulnerabilities such as prompt injection and improve agent robustness.
