skillwatch is an open-source CLI tool that monitors external URLs used by AI agent skills and MCP tools, detecting bait-and-switch content changes, homoglyph attacks, and other supply chain security risks for AI systems. Below are 9 llm eval & observability apps with similar functionality to skillwatch, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
skill-auditor is an open-source command-line tool that scans AI Agent skills for security issues before installation. It acts as an install gate, helping developers and maintainers ensure that only safe and validated skills are added to their AI agents. Ideal for those building or managing AI agent frameworks.
skillscan-trace is an open-source behavioral execution engine designed for MCP-based AI agent skills. It provides tools for analyzing, executing, and securing agent behaviors, supporting developers working with autonomous agent frameworks.
skillstat is an open-source command-line tool for diagnosing, auditing, and optimizing the skill usage of AI agents. It provides analytics and reports to help developers understand and improve agent performance across various tools.
skillfed is an open-source CLI tool that enables developers to discover and install vetted agent skills for Claude Code environments. It provides a no-clone installer that integrates with Claude Code and supports the Model Context Protocol (MCP), making it easy to add new skills via the command line. Designed for AI agent developers seeking streamlined skill management.
skillm is a command-line tool that acts as a universal skill registry, allowing users to register and reuse Python, Docker, CLI, and REST-based skills via the Model Context Protocol (MCP). It is aimed at automation developers and system integrators.
skilltotal is an open-source CLI tool for static security analysis of AI components, focusing on prompt injection and supply chain risks. It is designed for AI developers and security engineers to ensure the safety of AI systems.
skill-guard is an open-source CLI tool designed for AI developers to validate, secure, detect conflicts, and test agent skills. It provides a quality gate for agent skills, ensuring robust and secure deployment throughout their lifecycle. The tool is suitable for teams building or maintaining AI agents and skills.
Evaluate agent skills via static analysis, trigger testing, and trace analysis. Run `sklab` after installing to scan your skills.
skillboard is an open source command-line utility that helps developers manage and organize skills for AI coding agents. It provides a lightweight, terminal-based interface for skill management and is designed for integration with agent frameworks. Ideal for developers building or maintaining AI agents.
