mcpgawk is an open-source CLI tool for measuring and verifying MCP (Model Context Protocol) servers locally. Below are 6 llm eval & observability apps with similar functionality to mcpgawk, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
ai-agentic-mcpscan is an open-source command-line tool that provides local-first, offline-by-default security posture scanning for Model Context Protocol (MCP) and local-agent environments. It is intended for security engineers and teams managing agent-based infrastructures.
mcp-audits is an open-source CLI tool that scans, enumerates, and risk-scores permissions on locally configured MCP servers. It is designed for security engineers and AI infrastructure operators to ensure safe and compliant access control in AI systems.
mcp-checkup is an open-source CLI utility that audits MCP server setups, measuring context tax and hygiene. It helps AI infrastructure engineers and developers ensure their Model Context Protocol servers are efficient and healthy by providing detailed health checks and token analysis.
mcpscore is an open-source CLI tool that analyzes MCP servers for compliance, quality, and protocol validation. It generates comprehensive reports to help developers and administrators ensure their Model Context Protocol servers meet required standards.
mcp-config-audit is an open-source command-line tool that scans Model Context Protocol (MCP) configuration files for security issues. It operates locally, requiring no account or network connection, and outputs results in SARIF format. Designed for developers and security engineers who need to audit MCP configs securely and efficiently.
mcp-mcts is an open-source CLI tool for local MCP security scanning, attack chain analysis, inventory management, and CI integration. It supports optional Semgrep and LLM analysis, making it suitable for security engineers and DevOps teams focused on codebase security.
