PulseGatePost-LLM software, agents & workflows market (since 2022)
Coverage
166,772

Apps indexed

 

Freshness
7 min ago

Last update

 

Cadence
1,438/day

7-day average

Indexed today: 559

PulseGate

Market catalog for public software products, models, infra, and workflow tools.

Software is shipping faster than ever, and a growing share of it lives outside the official app stores. PulseGate is a free public catalog — built for builders, analysts, and everyday users.

Platform

  • All Apps
  • Categories
  • Industry Updates
  • Data Sources
  • Coverage Rules
  • Glossary
  • Embed Widget

Support

  • Help Center
  • Submit a Project
  • Report an Issue

Company

  • About
  • Press & Data
  • Contact
  • Platform Status

Legal

  • Privacy
  • Terms
  • Disclaimer

© 2026 PulseGate. Operated by Dymaxio s.r.o., Prague, Czech Republic.·

All systems operational
PulseGate
OP
openeval-llm
Visit ↗
  1. Home/
  2. LLM eval & observability/
  3. openeval-llm
←Back to results
O

openeval-llm

pypi.org·Infrastructure

openeval-llm is an open-source command-line tool that enables users to evaluate large language model outputs on five quality dimensions and compare different model runs. It supports models from OpenAI, OpenRouter, and Ollama, making it useful for ML engineers and researchers working on LLM benchmarking and quality assessment.

Open SourceMIT
CLI
O
Visit PyPI↗

Overview

6 features
  • ✓LLM evaluation
  • ✓CLI interface
  • ✓Model comparison
  • ✓Multi-metric scoring
  • ✓OpenAI support
  • ✓Ollama support

Tags

llm-evaluationcli-toolmodel-comparisonoutput-scoringllm-as-judge

AI capabilities

Text

Built with & integrations

AI providers
openai
Runs on
CLI

Trust & compliance

LicenseMIT
Verified signals
✓ HTTPS✓ Open Source✓ Free tier✓ GitHub✓ Active maintenance

Recent events

Latest indexed changes and source events

  1. IndexedJul 10, 8:21 AM

    openeval-llm discovered by the PulseGate indexer

    Source: PulseGate indexerOpen ↗

At a glance

Platforms
Cli
Languages
English
Open source
Yes (GitHub)
License
MIT
First seen
Jul 10, 2026
Activity
🟢 Active
Status
🟢 Active
Built for
machine learning engineers
Model
Open source
Solves
Evaluating and comparing the outputs of large language models across multiple quality dimensions.

Developer

Ece Dalpolat
Small team
↗ GitHub

Open source

View on GitHub →
⭐ Stars
0
🍴 Forks
0
Open issues
0
Last commit
2d ago
Commits 90d
20
Contributors
2
Authorship
Small team
Default branch
main
Latest release
v0.1.0 · 2d ago

PulseGate index

Confidence
Low · 64
Indexed
Jul 10, 2026
Lifecycle
Alive
Activity
Active
First seen
Jul 2026
Last seen
2d ago
Freshness
Unknown
Identity audit (9)
Entity ID
cmreo2pce0051zh0j3delc872
Slug
openeval-llm-pypi-org
Verification state
Indexed for public listing
Claim / listing state
Unclaimed · listed: yes
Index status
Included in index
Latest evidence snapshot
Jul 10, 2026
Timeline basis
Indexed-at chronology (no inferred launch/funding milestones).
Last updated
Jul 10, 2026
Canonical URL
https://pypi.org/project/openeval-llm

Similar apps

Other apps tracked under the same category.

  • evalflow
    github.com
  • evalshift
    pypi.org
  • DeepEval
    deepeval.com
  • mcp-llm-eval
    pypi.org
  • OpenJudge
    openjudge.me
  • evalforge
    pypi.org