openclaw-skill-vetter-mcp is an open-source MCP server that scans and security-vets third-party AI agent extensions, providing risk scores and static analysis to help developers and security teams prevent… Below are 15 llm eval & observability apps with similar functionality to openclaw-skill-vetter-mcp, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
openclaw-output-vetter-mcp is an open-source MCP server for verifying AI agent outputs, providing inline grounding checks, exception scanning, and transcript review. It is designed for developers and researchers working with AI agents who need robust evaluation and observability tools.
openclaw-health-mcp is an open-source MCP server for monitoring the health of AI agent deployments. It tracks gateway status, resource usage, errors, and skill registry integrity, providing cross-platform support for infrastructure operators and developers managing production AI systems.
openclaw-upgrade-orchestrator-mcp is an open-source CLI tool that manages safe upgrades for AI agent runtimes. It provides regression detection, catalog management, snapshot diffing, and rollback capabilities, supporting Anthropic and OpenAI providers. Designed for AI infrastructure teams.
Call any MCP server tool from the command line with shell composition support
openclaw-cost-tracker-mcp is an open-source MCP server that provides token-cost telemetry, quota-window awareness, anomaly detection, and spend forecasting for AI agents using providers like Anthropic, OpenAI, Gemini, and more. It helps AI ops teams manage costs and avoid quota exhaustion.
Security scanner for MCP (Model Context Protocol) servers - pentest your AI agent's tool connections
Ansible Knowledge MCP Server — module and role discovery, documentation, and skill generation for AI agents
progressive-skills-mcp is an open-source MCP server that exposes Claude-style skills to any MCP client. It facilitates integration and interoperability for AI infrastructure developers using the Model Context Protocol.
mcpvet is an open-source CLI tool that combines testing, linting, and contract validation for MCP servers. It integrates with pytest and ESLint, streamlining the development and quality assurance process for developers working with the Model Context Protocol.
shieldclaw-mcp is an open-source CLI tool that acts as a permission layer for AI agent tool calls on Model Context Protocol (MCP) servers. It enables allow, deny, or ask policies with comprehensive audit logging, helping developers enforce security and compliance in AI agent infrastructure.
Works With Agents MCP Server — 14 native tools for AI agent infrastructure. Facts, Pitfalls, Skills, Handoff Protocol, Blueprint Registry, Trust Scores, Identity Verification, SLA Validation, Compliance-as-Code.
Job search and ranking pipeline accessible via MCP (Model Context Protocol)
AI-powered security vulnerability scanner for MCP (Model Context Protocol) servers with automatic fixes, secret detection, and multi-channel alerts
vectra-ai-mcp-server is an open-source MCP server that exposes security detection, investigation, and response tools to AI assistants. It enables integration with AI-driven workflows for security automation and is suitable for security engineers and AI developers.
Static analysis tool for MCP server Python code — detects security vulnerabilities via AST and taint tracking.