agent-log-verifier is a command-line tool for post-hoc analysis of AI agent session logs, particularly Claude Code JSONL transcripts. Below are 11 llm eval & observability apps with similar functionality to agent-log-verifier, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
agent-ci-verify is an open-source CLI tool designed for integrating into CI/CD pipelines to verify AI agent outputs. It provides automated fact checking, schema validation, and diff verification, helping AI developers and DevOps teams maintain output quality and compliance.
AgentLogs is an open-source, self-hostable platform designed to provide observability into AI coding agent sessions within teams. It enables users to track every session, share prompts, and connect each conversation to the specific code commit it produced. The platform aims to give teams full visibility into their use of AI coding tools, helping them measure productivity and understand how agents are being utilized in their workflows. Key features of AgentLogs include session tracking, context sharing across team members, and the ability to build a knowledge base of effective prompts. The tool integrates with Git, allowing users to see which agent session generated particular code commits, provided the agent is responsible for the commit. AgentLogs supports several coding agents—specifically Claude Code, Codex CLI, OpenCode, Pi, and Cline—through lightweight plugins that capture session transcripts and automatically link them to Git commits. These transcripts can be shared with varying levels of visibility: private, team-only, or public, with default settings based on the repository's visibility and options to override per repository. AgentLogs places emphasis on data privacy and security. Before uploading any session transcript, it scans for secrets such as API keys, tokens, passwords, and database credentials using over 1,600 detection patterns. Any detected sensitive information is redacted locally, ensuring that secrets never leave the user's machine in plain text. 0 license. Users can deploy AgentLogs via an official Docker image or standalone binaries for self-hosting, or opt for a hosted cloud version. The codebase, including the CLI, web app, and plugins, is available on GitHub. AgentLogs is positioned as a tool for teams seeking to understand and improve their use of AI coding agents, focusing on session and prompt-level attribution rather than code-level tracking.
agentverify is an open-source Python library for deterministic testing of AI agents. It allows developers to assert agent actions, record and replay interactions, and integrate with CI pipelines using pytest. Ideal for teams building and maintaining AI agent workflows who need reliable, repeatable tests.
agentaudit-scanner is an open-source CLI tool that scans AI agent skills, rule files, and MCP configurations for security risks like prompt injections and hidden instructions. It is designed for AI security engineers and developers to ensure safe agent deployments.
agentproof-scan is an open-source CLI security scanner designed to probe AI-agent HTTP endpoints for secret and prompt leakage. It integrates with CI pipelines using exit codes to automate security checks, helping developers and security engineers ensure their AI agents are not exposing sensitive information.
agent-audit-logger is an open-source Python middleware that wraps agent frameworks to log every tool call, providing SOC 2 audit trails for small teams and developers needing compliance and traceability.
agentlint-trace is an open-source command-line tool that acts as a linter for AI agent execution traces, designed for integration with CI pipelines. It helps AI developers validate and enforce policies on agent traces to ensure correctness and compliance during automated testing.
agent-rules-lint is an open-source CLI tool that checks and validates AI agent instruction files such as AGENTS.md, CLAUDE.md, and Copilot rules. It helps developers maintain clear, consistent, and error-free agent documentation and configuration files.
agent-debug is an open-source CLI tool for diagnosing failures in AI agent workflows. It provides root cause analysis and actionable fix suggestions, helping AI developers and researchers debug and improve their agent systems.
agent-probe-ai is an open-source CLI tool for adversarial resilience testing of AI agents. It evaluates agent robustness against attacks like memory poisoning and tool misuse, helping AI researchers and security engineers identify vulnerabilities.
agentlint is an open-source CLI tool that provides real-time quality guardrails and linting for AI coding agents. It helps developers maintain code quality and safety by integrating with agentic coding workflows and enforcing best practices.
