digline is an open-source project built for developers building and testing LLM applications.

What platforms does digline run on?

digline runs on the command line. It can also be self-hosted.

Is digline still maintained?

The GitHub repository shows 162 commits in the last 90 days.

digline is developed by digline.

Back to the index

digline

Name: digline
Author: digline

digline.devInfrastructure

digline is a Python CLI for regression testing LLM applications against approved baselines stored in a repository. It compares evaluation runs, identifies degraded checks, and reports configuration changes that may explain quality drops for developers maintaining LLM systems.

Apache-2.0CLISelf-hosted

Visit digline.dev

5stars

1alternative

8features

2026since

Overview

8 features

digline sits in PulseGate's Agent evaluation & testing category. It focuses on detecting quality regressions in LLM applications when outputs lack exact expected answers. It is built as an open-source project for developers building and testing LLM applications. It runs on the command line, and it can be self-hosted.

digline builds and maintains digline, and it first shipped in 2026. The project is developed in the open on GitHub with 162 commits in the last 90 days. Key capabilities include baseline comparisons, regression detection, and repository baselines.

Summary written by a language model from the project’s public pages.

Baseline comparisons
Regression detection
Repository baselines
LLM rubric checks
Configuration tracking
CLI reports
Threshold checks
Suite comparison

Built with & integrations

Written with

Claude Code

Runs on

CLISelf-hosted

Written with — evidence

Claude Code: commit b1ea0bedc283 · since Sept 2026

Trust & compliance

License

Apache-2.0

Verified signals

HTTPSActive maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed10 Sept · 01:43 UTC
My LLM eval cried wolf. Here's what I measured verified via Hacker News firehose (Algolia)
Source: Hacker News firehose (Algolia) · Open

Frequently asked questions about digline

What is digline?: Digline focuses on detecting quality regressions in LLM applications when outputs lack exact expected answers. It is catalogued under Agent evaluation & testing on PulseGate.
Who is digline for?: digline is an open-source project built for developers building and testing LLM applications.
What platforms does digline run on?: digline runs on the command line. It can also be self-hosted.
Is digline still maintained?: The GitHub repository shows 162 commits in the last 90 days.
Who makes digline?: digline is developed by digline.
When did digline launch?: digline first shipped in 2026.

At a glance

Pricing: Free
Platforms: CLI
Languages: English
License: Apache-2.0
First seen: 10 Sept 2026
Built for: developers building and testing LLM applications
Model: Open source
Solves: Detecting quality regressions in LLM applications when outputs lack exact expected answers.

Developer

Solo developer

Open source

Stars: 5
Forks: 0
Open issues: 1
Last commit: 9 Sept 2026
Commits 90d: 162
Contributors: 1
Authorship: Solo
Default branch: main

Index record

Indexed: 10 Sept 2026
Lifecycle: Alive
First seen: Sept 2026
Last seen: 10 Sept 2026

Identity audit (13)

Slug: my-llm-eval-cried-wolf-here-s-what-i-measured-digline-dev
Lifecycle state recorded: 10 Sept 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 10 Sept 2026
Timeline basis: Indexed-at chronology (no inferred launch/funding milestones).
Name from: Derived from the project's own page and URL.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model, checked against the page's own declaration.
Last updated: 10 Sept 2026
Canonical URL: https://digline.dev/

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do

diglinepypi.org