omegaprompt
omegaprompt is an open-source CLI tool for calibrating and evaluating prompts across Anthropic, OpenAI, Gemini, and local LLMs. It provides sensitivity-ranked scoring, risk reporting, and plugin support for advanced prompt engineering workflows. Designed for LLMOps and prompt engineers seeking robust, provider-neutral evaluation.
Overview
8 featuresIn the LLM eval & observability space, omegaprompt takes a focused approach. It focuses on ensuring reliable and comparable prompt evaluation and calibration across multiple LLM providers. omegaprompt is an open-source project aimed at LLM evaluators and prompt engineers. The project is open source (Apache-2.0). It runs on the command line, and it can be self-hosted.
hibou04-ops builds and maintains omegaprompt, and it first shipped in 2026. Development happens publicly on GitHub with 73 commits in the last 90 days. Among its 8 catalogued features are prompt calibration, sensitivity ranking, and meta-axes scoring. It exposes integrations via an MCP server.
Summary written by a language model from the project’s public pages.
- Prompt calibration
- Sensitivity ranking
- Meta-axes scoring
- Provider-neutral
- Risk reporting
- Plugin interface
- LLM evaluation
- Guarded profiles
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about omegaprompt
- What does omegaprompt do?
- Omegaprompt focuses on ensuring reliable and comparable prompt evaluation and calibration across multiple LLM providers. It is catalogued under LLM eval & observability on PulseGate.
- Who is omegaprompt for?
- omegaprompt is an open-source project built for LLM evaluators and prompt engineers.
- Does omegaprompt have a free plan?
- Yes — omegaprompt is open source under the Apache-2.0 license and free to use.
- What platforms does omegaprompt run on?
- omegaprompt runs on the command line. It can also be self-hosted.
- Is omegaprompt still maintained?
- The GitHub repository shows 73 commits in the last 90 days.
- What are alternatives to omegaprompt?
- Similar projects tracked by PulseGate include PromptEval, Prompt Optimizer, and Promptmetheus.PromptEvalPrompt OptimizerPromptmetheus
- Who develops omegaprompt?
- omegaprompt is developed by hibou04-ops.
- How long has omegaprompt been around?
- omegaprompt first shipped in 2026.
Similar projects
Closest matches by what these projects do