tuieval
PulseGate's liveness check found it on 1 Oct 2026; it is registered on PyPI and has been in the index since 1 Oct 2026. How this is checked
tuieval is an open-source command-line tool for evaluating local large language models against user-defined evaluation packs. It reports accuracy, speed, and token metrics with PASS/FAIL verdicts, supporting workflows involving tools such as llama.cpp.
Inferred · not functionally tested
Overview
6 featuresPurpose: Benchmarking local LLMs and comparing their accuracy, speed, and token usage.
Inferred · not functionally tested
Audience: developers and ML engineers evaluating local language models
Inferred · not functionally tested
Functions: analytics
Inferred · not functionally tested
Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)
Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: cli, self_hosted
Constraint provenance is unknown; confirm requirements with the publisher.
Record sources: pypi.org. These links do not verify the individual claims.
tuieval sits in PulseGate's LLM evaluation & benchmarks category. Inferred · not functionally tested: It focuses on benchmarking local LLMs and comparing their accuracy, speed, and token usage. Inferred · not functionally tested: It is built as an open-source project for developers and ML engineers evaluating local language models. Basis unknown · not verified: tuieval is open source under the MIT license. Basis unknown · not verified: tuieval is available on the command line, and it can be self-hosted.
tuieval first shipped in 2026. Inferred · not functionally tested: Key capabilities include eval packs, accuracy metrics, and speed metrics.
Summary written by a language model from the project’s public pages.
Tasks: Inferred · not functionally tested
- Eval packs
- Accuracy metrics
- Speed metrics
- Token metrics
- Pass/fail verdicts
- Terminal interface
Topics: Inferred · not functionally tested
Built with & integrations
Trust & compliance
Indexing history
24What PulseGate has recorded for this listing
Frequently asked questions about tuieval
- What is tuieval?
- Inferred · not functionally tested: Tuieval focuses on benchmarking local LLMs and comparing their accuracy, speed, and token usage. It is catalogued under LLM evaluation & benchmarks on PulseGate.
- Who should use tuieval?
- Inferred · not functionally tested: tuieval is an open-source project built for developers and ML engineers evaluating local language models.
- Does tuieval have a free plan?
- Basis unknown · not verified: Yes — tuieval is open source under the MIT license and free to use.
- What platforms does tuieval run on?
- Basis unknown · not verified: tuieval runs on the command line. It can also be self-hosted.
- Is tuieval still active?
- PulseGate's liveness check found it on 1 Oct 2026.
- What are alternatives to tuieval?
- Similar projects tracked by PulseGate include contamcheck, quantdiff, and rerun-bench.contamcheckquantdiffrerun-bench
- How long has tuieval been around?
- tuieval first shipped in 2026.
- Is tuieval open source?
- Basis unknown · not verified: Yes — tuieval is open source under the MIT license.
Also in LLM evaluation & benchmarks
Same category — not a similarity match