agent-redteam is an open-source platform for red team security testing of AI agents, focusing on vulnerabilities such as prompt injection and LLM safety. Below are 12 llm eval & observability apps with similar functionality to agent-redteam, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
Agent Red Team is a web platform that allows AI engineers and founders to test their AI agents for vulnerabilities to unauthorized actions. It provides automated code checks, exploit path detection, and actionable remediation suggestions to improve agent security before deployment.
argus-redteam-agent is a command-line security scan agent that performs local vulnerability assessments, including SAST and SCA, ensuring code never leaves the user's infrastructure. It is designed for security engineers and DevOps teams prioritizing privacy and compliance.
agentdef is an open-source CLI tool and specification for defining AI agents in a portable, framework-agnostic way. It enables developers to standardize agent definitions and streamline deployment across different AI frameworks.
agent-probe-ai is an open-source CLI tool for adversarial resilience testing of AI agents. It evaluates agent robustness against attacks like memory poisoning and tool misuse, helping AI researchers and security engineers identify vulnerabilities.
grendel-redteam is an open-source CLI tool designed for security researchers and developers to red-team AI agents. It simulates authorized attacks, such as prompt injection and jailbreaks, to evaluate the robustness of LLM and agent-based systems.
redteam-os-agent is a CLI-based runtime agent designed for pull-based task execution in RedOS environments. It enables automation and efficient management of worker tasks, making it suitable for DevOps and IT professionals.
agentsec-cli is an open-source CLI tool that performs static security analysis on AI coding agents and Model Context Protocol (MCP) configurations. It helps developers and security teams identify vulnerabilities and misconfigurations in agent-based AI systems before deployment.
agentrepocoach is an open-source CLI tool that analyzes codebases to determine their readiness for AI agent integration. It provides a readiness score and actionable coaching to help developers improve code quality for agent compatibility.
agent-squad is an open-source Python framework for creating, orchestrating, and managing squads of autonomous AI agents. It provides a CLI interface and is designed for developers and researchers building complex agent-based systems. The project is licensed under Apache 2.0 and available on GitHub.
agentsentinel-cli is an open-source command-line tool that provides security scanning, static analysis, supply chain auditing, and multi-agent trust analysis for AI agents and MCP servers. It helps developers and security engineers identify vulnerabilities and ensure compliance with security best practices in agentic systems.
AgentTeams is a web-based platform that provides execution governance, workflow management, and auditability for teams using AI coding agents. It enables versioned conventions, linked reports, and postmortem tracking to ensure transparency and control over autonomous agent workflows. Designed for engineering teams integrating AI agents into their development processes.
agentaudit-scanner is an open-source CLI tool that scans AI agent skills, rule files, and MCP configurations for security risks like prompt injections and hidden instructions. It is designed for AI security engineers and developers to ensure safe agent deployments.
