PulseGateLive intelligence on AI-era software
Coverage
175,612

Software tracked

 

Freshness
44 min ago

Last update

 

Cadence
487/day

7-day average

Indexed today: 805

PulseGate

Live intelligence on the software shipping in the AI era — apps, models, agents, and infra.

Software is shipping faster than ever, and a growing share of it lives outside the official app stores. PulseGate tracks it live — free, for builders, analysts, and everyone keeping up.

Follow
GitHubX (Twitter)LinkedIn

Platform

  • All Apps
  • Full Index
  • Categories
  • Industry Updates
  • Data Sources
  • Coverage Rules
  • Glossary
  • Embed Widget

Support

  • Help Center
  • Suggest a URL
  • Report an Issue

Company

  • About
  • Dimaxia
  • Press & Data
  • Contact
  • Platform Status

Legal

  • Privacy
  • Terms
  • Disclaimer

© 2026 PulseGate. Operated by Dimaxia, a brand of Dymaxio s.r.o., Prague, Czech Republic.·

All systems operational
PulseGate
RO
robotframework-agenteval
Visit ↗
  1. Home/
  2. Testing & QA/
  3. robotframework-agenteval
←Back to results
R

robotframework-agenteval

PyPI·Infrastructure

robotframework-agenteval is an open-source library for Robot Framework that enables automated testing of agentic stacks, including MCP servers, Agent Skills, SubAgents, and Hooks. It supports deterministic, LLM-judged, and coding agent-based evaluation, making it suitable for developers and QA engineers working with AI agents.

Open SourceApache-2.0
CLI
R
Visit PyPI↗
⭐1
star
✓5
features
📅2026
since

Overview

5 features

robotframework-agenteval sits in PulseGate's Testing & QA category. It focuses on automating and evaluating the testing of agentic stacks and MCP servers using Robot Framework and LLM-based methods. robotframework-agenteval is an open-source project aimed at test automation engineers and AI agent developers. The project is open source (Apache-2.0). robotframework-agenteval is available on the command line.

Behind robotframework-agenteval is manykarim, and the product first shipped in 2026. The project is developed in the open on GitHub with 194 commits in the last 90 days. Among its 5 catalogued features are agentic stack testing, LLM judge integration, and MCP server support. It exposes integrations via an MCP server.

  • ✓Agentic stack testing
  • ✓LLM judge integration
  • ✓MCP server support
  • ✓SubAgent evaluation
  • ✓Deterministic testing

Tags

robotframework-libraryagent-testingllm-evaluation

AI capabilities

Code

Built with & integrations

Connectors
MCP
Runs on
CLI

Trust & compliance

LicenseApache-2.0
Verified signals
✓ HTTPS✓ Open Source✓ Free tier✓ GitHub · ★ 1✓ Active maintenance

Recent events

Latest indexed changes and source events

  1. IndexedJul 17, 3:48 PM

    robotframework-agenteval verified by the PulseGate indexer

    Source: PulseGate indexerOpen ↗
  2. IndexedJul 17, 3:48 PM

    robotframework-agenteval verified by the PulseGate indexer

    Source: PulseGate indexerOpen ↗

Frequently asked questions about robotframework-agenteval

What is robotframework-agenteval?
Robotframework-agenteval focuses on automating and evaluating the testing of agentic stacks and MCP servers using Robot Framework and LLM-based methods. It is catalogued under Testing & QA on PulseGate.
Who should use robotframework-agenteval?
robotframework-agenteval is an open-source project built for test automation engineers and AI agent developers.
Does robotframework-agenteval have a free plan?
Yes — robotframework-agenteval is open source under the Apache-2.0 license and free to use.
What platforms does robotframework-agenteval run on?
robotframework-agenteval runs on the command line.
Is robotframework-agenteval still active?
PulseGate's liveness checks currently classify robotframework-agenteval as active. The GitHub repository shows 194 commits in the last 90 days.
What tools are similar to robotframework-agenteval?
Similar tools tracked by PulseGate include openagent-eval, AgentEval, and agentanvil.openagent-evalAgentEvalagentanvil
Who develops robotframework-agenteval?
robotframework-agenteval is developed by manykarim.
How long has robotframework-agenteval been around?
robotframework-agenteval first shipped in 2026.

At a glance

Platforms
Cli
Languages
English
Open source
Yes · ★ 1
License
Apache-2.0
First seen
Jul 17, 2026
Activity
🟢 Active
Status
🟢 Active
Built for
test automation engineers and AI agent developers
Model
Open source
Solves
Automating and evaluating the testing of agentic stacks and MCP servers using Robot Framework and LLM-based methods.

Developer

manykarim
Solo developer
↗ GitHub

Open source

View on GitHub →
⭐ Stars
1
🍴 Forks
0
Open issues
0
Last commit
4d ago
Commits 90d
194
Contributors
1
Authorship
Solo
Default branch
main

Live coverage

Confidence
Low · 64
Indexed
Jul 17, 2026
Lifecycle
Alive
Activity
Active
First seen
Jul 2026
Last seen
4d ago
Identity audit (9)
Entity ID
cmrp43za209k8xwk0syes60dy
Slug
robotframework-agenteval-pypi-org
Verification state
Indexed for public listing
Claim / listing state
Unclaimed · listed: yes
Index status
Included in index
Latest evidence snapshot
Jul 17, 2026
Timeline basis
Indexed-at chronology (no inferred launch/funding milestones).
Last updated
Jul 17, 2026
Canonical URL
https://pypi.org/project/robotframework-agenteval

Similar apps

Other apps tracked under the same category.

  • openagent-eval
    pypi.org
  • AgentEval
    agenteval.dev
  • agentanvil
    github.com
  • agentaudit-eval
    pypi.org
  • agentos-framework
    pypi.org
  • agent-eval
    pypi.org