Designing, running, and evaluating repeatable LLM experiments across curated datasets. It is catalogued under Data science & ML workbench on PulseGate.

Who should use llmexer?

llmexer is an open-source project built for ML researchers and developers.

Yes — llmexer is open source under the MIT license and free to use.

What platforms does llmexer run on?

llmexer runs on the command line. It can also be self-hosted.

Is llmexer still active?

The GitHub repository shows 34 commits in the last 90 days.

llmexer is developed by vdmitriyev.

Is llmexer open source?

Yes — llmexer is open source under the MIT license, developed on GitHub.

Back to the index

llmexer

Name: llmexer
Author: vdmitriyev

PyPIInfrastructure

llmexer is an open-source framework and CLI for creating and curating datasets, then designing, running, and evaluating LLM experiments. It supports datasets such as publications, metadata, and prompts for developers and ML researchers.

Open SourceMITCLISelf-hosted

Visit PyPI

1star

6features

2026since

Overview

6 features

In the Data science & ML workbench space, llmexer takes a focused approach. Designing, running, and evaluating repeatable LLM experiments across curated datasets. llmexer is an open-source project aimed at ML researchers and developers. The project is open source (MIT). It ships for the command line, and it can be self-hosted.

vdmitriyev builds and maintains llmexer, and it first shipped in 2026. Development happens publicly on GitHub with 34 commits in the last 90 days. Key capabilities include dataset creation, dataset curation, and experiment design.

Summary written by a language model from the project’s public pages.

Dataset creation
Dataset curation
Experiment design
Experiment execution
Experiment evaluation
CLI utility

Built with & integrations

AI providers

openai

Connectors

github

Runs on

CLISelf-hosted

Trust & compliance

License

MIT

Verified signals

HTTPSOpen SourceFree tierGitHub · ★ 1Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed16 Aug · 17:07 UTC
llmexer verified against its public source
Source: PulseGate · Open

Frequently asked questions about llmexer

What is llmexer?: Designing, running, and evaluating repeatable LLM experiments across curated datasets. It is catalogued under Data science & ML workbench on PulseGate.
Who should use llmexer?: llmexer is an open-source project built for ML researchers and developers.
Is llmexer free?: Yes — llmexer is open source under the MIT license and free to use.
What platforms does llmexer run on?: llmexer runs on the command line. It can also be self-hosted.
Is llmexer still active?: The GitHub repository shows 34 commits in the last 90 days.
Who makes llmexer?: llmexer is developed by vdmitriyev.
How long has llmexer been around?: llmexer first shipped in 2026.
Is llmexer open source?: Yes — llmexer is open source under the MIT license, developed on GitHub.

At a glance

Platforms: Cli
Languages: English
Open source: Yes · ★ 1
License: MIT
First seen: 16 Aug 2026
Built for: ML researchers and developers
Model: Open source
Solves: Designing, running, and evaluating repeatable LLM experiments across curated datasets.

Registered as

GitHub: vdmitriyev/llmexer
PyPI: llmexer

Developer

vdmitriyev

Small team

GitHub

Open source

View on GitHub

Stars: 1
Forks: 0
Open issues: 0
Last commit: 16 Aug 2026
Commits 90d: 34
Contributors: 2
Authorship: Small team
Default branch: main
Latest release: 0.3.1 · 16 Aug 2026

Index record

Identity confidence: Low · 64
Indexed: 16 Aug 2026
Lifecycle: Alive
First seen: Aug 2026
Last seen: 16 Aug 2026

Identity audit (13)

Slug: llmexer-pypi-org
Lifecycle state recorded: 16 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 16 Aug 2026
Timeline basis: Indexed-at chronology (no inferred launch/funding milestones).
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Last updated: 16 Aug 2026
Canonical URL: https://pypi.org/project/llmexer

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do