Who should use subset2evaluate?

subset2evaluate is an open-source project built for nlp researchers.

Does subset2evaluate have a free plan?

Yes — subset2evaluate is open source under the MIT license and free to use.

What platforms does subset2evaluate run on?

subset2evaluate runs on the command line.

Is subset2evaluate still maintained?

The GitHub repository shows 1 commit in the last 90 days.

What projects are similar to subset2evaluate?

Similar projects tracked by PulseGate include constraintloop, trajectory-judge, and DeFake.

Who makes subset2evaluate?

subset2evaluate is developed by zouharvi.

How long has subset2evaluate been around?

subset2evaluate first shipped in 2024.

Back to the index

subset2evaluate

Name: subset2evaluate
Author: zouharvi

github.comInfrastructure

subset2evaluate is an open-source CLI tool that helps NLP researchers efficiently select informative subsets of examples for human evaluation of natural language generation (NLG) models. It optimizes the evaluation process by focusing on the most relevant samples.

Open SourceMITCLI

Visit github.com

17stars

3forks

4features

2024since

Overview

4 features

subset2evaluate is a LLM eval & observability project. It focuses on selecting the most informative examples to streamline human evaluation of natural language generation models. subset2evaluate is an open-source project aimed at nlp researchers. The project is open source (MIT). It ships for the command line.

Behind subset2evaluate is zouharvi, and it first shipped in 2024. Development happens publicly on GitHub with 17 stars and 1 commit in the last 90 days. Key capabilities include example selection, human evaluation support, and NLG model evaluation.

Summary written by a language model from the project’s public pages.

Example selection
Human evaluation support
NLG model evaluation
CLI interface

Built with & integrations

Runs on

CLI

Trust & compliance

License

MIT

Verified signals

HTTPSOpen SourceFree tierGitHub · ★ 17Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed27 Jun · 11:07 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about subset2evaluate

What is subset2evaluate?: Subset2evaluate focuses on selecting the most informative examples to streamline human evaluation of natural language generation models. It is catalogued under LLM eval & observability on PulseGate.
Who should use subset2evaluate?: subset2evaluate is an open-source project built for nlp researchers.
Does subset2evaluate have a free plan?: Yes — subset2evaluate is open source under the MIT license and free to use.
What platforms does subset2evaluate run on?: subset2evaluate runs on the command line.
Is subset2evaluate still maintained?: The GitHub repository shows 1 commit in the last 90 days.
What projects are similar to subset2evaluate?: Similar projects tracked by PulseGate include constraintloop, trajectory-judge, and DeFake.constraintloop trajectory-judge DeFake
Who makes subset2evaluate?: subset2evaluate is developed by zouharvi.
How long has subset2evaluate been around?: subset2evaluate first shipped in 2024.

At a glance

Platforms: Cli
Languages: English
Open source: Yes · ★ 17
License: MIT
Built for: nlp researchers
Model: Open source
Solves: Selecting the most informative examples to streamline human evaluation of natural language generation models.

Registered as

GitHub: zouharvi/subset2evaluate
PyPI: subset2evaluate

Developer

zouharvi

Small team

GitHub

Open source

View on GitHub

Stars: 17
Forks: 3
Open issues: 7
Last commit: 22 Apr 2026
Commits 90d: 1
Contributors: 5
Authorship: Small team
Default branch: main

Live coverage

Identity confidence: Low · 64
Indexed: 27 Jun 2026
Lifecycle: Unverified
Last seen: 27 Jun 2026

Identity audit (12)

Slug: subset2evaluate-pypi-org
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 27 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Last updated: 27 Jun 2026
Canonical URL: https://github.com/zouharvi/subset2evaluate

Ship this? Send a correction — no account, and you get a link to follow it.

Also in LLM eval & observability

Same category — not a similarity match