PulseGateIndexCategoriesUpdatesLive intelligence on AI-era software— indexed in the last hour
Coverage—projects tracked
Freshness—newest entry
Cadence—last week average · — today
Index9 markets86 categories
PulseGate

Live intelligence on the AI-era software market — apps, models, agents and infrastructure.

Most of it never reaches an official store. PulseGate maps the whole market — every category, worldwide — and measures how it moves: what’s launching, what’s gaining, what’s going quiet.

FollowGitHubX (Twitter)LinkedIn
Platform
All AppsFull IndexCategoriesIndustry UpdatesData SourcesCoverage RulesGlossaryEmbed Widget
Support
Help CenterSubmit your projectReport an Issue
Company
AboutDimaxiaPress & DataContactPlatform Status
Legal
PrivacyTermsDisclaimer
Dimaxia · Dymaxio s.r.o. · Prague, Czechia · © 2026WatchlistSitemapSystem status
PulseGateNOnotorious
Visit↗
Skip to content
  1. Index›
  2. LLM eval & observability›
  3. notorious
← Back to the index
NO

notorious

PyPI·Infrastructure

notorious is an open-source Python package for evaluating information retrieval systems using LLM-based judgments. It enables users to pool candidates, apply custom rubrics, and measure judge-vs-human alignment, supporting advanced evaluation workflows for AI researchers and developers.

Open SourceMITCLI
Visit PyPI↗

Overview

5 features

notorious is a LLM eval & observability project. It focuses on evaluating retrieval systems with LLM-based judgments and measuring alignment with human assessments. notorious is an open-source project aimed at AI researchers and developers. The project is open source (MIT). It runs on the command line.

Behind notorious is georgian-io, and it first shipped in 2026. Key capabilities include retrieval evaluation, LLM-based judging, and human alignment metrics.

Summary written by a language model from the project’s public pages.

  • ✓Retrieval evaluation
  • ✓LLM-based judging
  • ✓Human alignment metrics
  • ✓Custom rubrics
  • ✓Python integration
Tags
retrieval-evaluationllm-judgingpython-packagerag-evalranking-metrics
AI capabilities
TextStructured
Weights: Open

Built with & integrations

Runs on
CLI

Trust & compliance

License
MIT
Verified signals
✓HTTPS✓Open Source✓Free tier✓GitHub

Indexing history

1

What PulseGate has recorded for this listing

  1. Indexed16 Jul · 21:31 UTC
    notorious verified against its public source
    Source: PulseGate · Open ↗

Frequently asked questions about notorious

What is notorious?
Notorious focuses on evaluating retrieval systems with LLM-based judgments and measuring alignment with human assessments. It is catalogued under LLM eval & observability on PulseGate.
Who is notorious for?
notorious is an open-source project built for AI researchers and developers.
Is notorious free?
Yes — notorious is open source under the MIT license and free to use.
What platforms does notorious run on?
notorious runs on the command line.
Is notorious still maintained?
Unverified. notorious has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
What are alternatives to notorious?
Similar projects tracked by PulseGate include constraintloop, trajectory-judge, and DeFake.constraintlooptrajectory-judgeDeFake
Who makes notorious?
notorious is developed by georgian-io.
When did notorious launch?
notorious first shipped in 2026.

At a glance

Platforms
Cli
Languages
English
Open source
Yes (GitHub)
License
MIT
First seen
16 Jul 2026
Built for
AI researchers and developers
Model
Open source
Solves
Evaluating retrieval systems with LLM-based judgments and measuring alignment with human assessments.

Registered as

GitHub
georgian-io/notorious
PyPI
notorious

Developer

georgian-io
↗ GitHub

Open source

View on GitHub →

Live coverage

Identity confidence
Low · 64
Indexed
16 Jul 2026
Lifecycle
Unverified
First seen
Jul 2026
Last seen
16 Jul 2026
Identity audit (12)
Slug
notorious-pypi-org
Verification state
Indexed for public listing
Listing state
Listed: yes
Index status
Included in index
Latest evidence snapshot
16 Jul 2026
Timeline basis
Indexed-at chronology (no inferred launch/funding milestones).
Name from
Written by a language model from the project's public pages.
Category from
Assigned by a language model.
Summary from
Written by a language model from public pages.
Languages from
Detected by a language model from page content.
Last updated
16 Jul 2026
Canonical URL
https://pypi.org/project/notorious

Ship this? Send a correction — no account, and you get a link to follow it.

Also in LLM eval & observability

Same category — not a similarity match

  • COconstraintlooppypi.org
  • TRtrajectory-judgepypi.org
  • DEDeFakedefakes.com
  • COcognisafecognisafe.uk
  • COCOHESIONcohesionauth.com
  • ASAI Slop Indexvibeaxis.com