Unified CLI for the Agent Quality Toolkit (agentmd, coderace, agentlint, agentreflect) Below are 39 llm eval & observability apps with similar functionality to agentkit-cli, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
CLI-Toolkit für AI-Agent-Infrastruktur: .agent-Ordner, Tool-Discovery, Credential-Management
A suite of AI-powered command-line tools for text correction, audio transcription, and voice assistance.
Lighthouse for AI agent development environments
Evaluation harness for real headless CLI agents - reproducible multi-turn scenarios, rule + LLM scoring, cross-agent comparison
AI-native quality gate for agent-generated code — scan, audit, auto-fix, trend
agentbench-cli is an open-source command-line tool that allows AI developers and researchers to evaluate, test, and scan the behavior and safety of AI agents. It provides automated checks and reporting for agent performance and compliance.
agent-audit-kit is an open-source CLI tool that scans MCP-connected AI agent pipelines for security vulnerabilities. It helps AI security engineers ensure the safety and compliance of agent-based workflows.
Local AI-agent usage analytics and persona archetypes
Evidence-first, artifact-driven bug triage workflow for CLI agents
Contract-based testing framework for LLM agents — hybrid metrics (objective + LLM-as-judge + human), multi-agent and A2A protocol support, deterministic record/replay envelope.
AgentX - Native compiled Python agent framework
Self-describing local inbox for coding agents
Language-agnostic correctness checker for scientific numerical code
Agent testing SDK. Instrument, assert, classify.
Agent Brain CLI - Command-line interface for managing AI agent memory and knowledge retrieval
aiagenthub-cli is an open-source command-line tool for running and managing AI agents. It supports agent registry, Docker integration, and automation, targeting developers building or orchestrating AI agent workflows.
Capability-first Codex control plane for long-running developer workflows.
Thin CLI + MCP client for Agent-CoreX — execute any task with a single query
Agent evaluation toolkit
Terminal interface for Deep Agents - interactive AI agent with file operations, shell access, and sub-agent capabilities.
Lint, score, and optimize AI agent configuration files (CLAUDE.md, AGENTS.md, Cursor rules)
Autonomous Offensive Security Intelligence - AI-powered penetration testing
A multi-agent AI coding system with built-in RAG — local or cloud, CLI or API.
agent-id-cli is an open-source command-line interface for managing identities of AI agents. It allows developers to create, update, and organize agent identities efficiently. Suitable for AI developers and teams working with multiple agents.
Agent tools in Python (web, files, terminal, browser, memory, cron, and more).
Pick the right tools for an agent task. Boring baseline. Open dataset.
antoine — codebase lookup and indexing for agent skills (greenfield AgentCulture sibling).
KISS Agent Framework - A simple and portable agent framework for building and evolving AI agents
Governed AI delivery kit — spec-driven scaffolding for AI coding agents
agentshield-cli is an open-source CLI tool for automating quality assurance and enforcing quality gates in software development. It integrates with AgentShield to help QA engineers maintain code quality standards.
Agent Kitchen is an open-source dashboard for monitoring and analyzing AI coding agent sessions, supporting both Claude Code and Codex CLI. It helps developers and researchers gain insights into agent performance and workflows.
Clone AI agent configurations into any project
agentcode-cli is an open-source command-line tool that brings agentic coding capabilities inspired by Claude Code. It supports multiple AI models and is designed for developers who want to automate or enhance coding workflows using AI agents.
Score any URL for AI-agent readiness — llms.txt, JSON-LD, AI-bot robots.txt, canonical, MCP, meta, sitemap.
Restart-on-exit supervisor for autonomous CLI agents
A CLI-driven virtual filesystem for AI agents
CLI tool for deploying and managing AI coding agent configurations (MCP servers, skills, instructions) across multiple providers.
Persistent decision memory for any project. Karpathy's LLM Wiki, productized.
agentlint is an open-source CLI tool that provides real-time quality guardrails and linting for AI coding agents. It helps developers maintain code quality and safety by integrating with agentic coding workflows and enforcing best practices.
