notorious is an open-source Python package for evaluating information retrieval systems using LLM-based judgments. It enables users to pool candidates, apply custom rubrics, and measure judge-vs-human alignment, supporting advanced evaluation workflows for AI researchers and developers.
notorious is a LLM eval & observability project. It focuses on evaluating retrieval systems with LLM-based judgments and measuring alignment with human assessments. notorious is an open-source project aimed at AI researchers and developers. The project is open source (MIT). It runs on the command line.
Behind notorious is georgian-io, and it first shipped in 2026. Key capabilities include retrieval evaluation, LLM-based judging, and human alignment metrics.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Same category — not a similarity match