rubric_llm
rubric_llm is a lightweight open-source Ruby framework for evaluating large language model outputs against defined rubrics. It is intended for developers testing and benchmarking LLM-powered applications.
Overview
5 featuresIn the LLM evaluation & benchmarks space, rubric_llm takes a focused approach. It focuses on evaluating and comparing LLM outputs consistently in Ruby projects. It is built as an open-source project for ruby developers building or testing LLM applications. The project is open source (Open Source). It ships for the web and the command line, and it can be self-hosted.
It is developed by dpaluy. Among its 5 catalogued features are custom rubrics, LLM evaluation, and ruby integration.
Summary written by a language model from the project’s public pages.
- Custom rubrics
- LLM evaluation
- Ruby integration
- Output scoring
- Evaluation reports
Built with & integrations
- openai
- bgpt- in the HTML
- anthropic
- bclaude in the HTML · bclaude- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed9 Sept · 08:20 UTCrubric_llm verified via RubyGems just-updatedSource: RubyGems just-updated · Open
Frequently asked questions about rubric_llm
- What does rubric_llm do?
- Rubric_llm focuses on evaluating and comparing LLM outputs consistently in Ruby projects. It is catalogued under LLM evaluation & benchmarks on PulseGate.
- Who should use rubric_llm?
- rubric_llm is an open-source project built for ruby developers building or testing LLM applications.
- Does rubric_llm have a free plan?
- Yes — rubric_llm is open source under the Open Source license and free to use.
- What platforms does rubric_llm run on?
- rubric_llm runs on the web and the command line. It can also be self-hosted.
- Is rubric_llm still active?
- Unverified. rubric_llm has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What are alternatives to rubric_llm?
- Similar projects tracked by PulseGate include RubyLLM, rubric-eval, and llm.rb.RubyLLMrubric-evalllm.rb
- Who develops rubric_llm?
- rubric_llm is developed by dpaluy.
- Is rubric_llm open source?
- Yes — rubric_llm is open source under the Open Source license.
Similar projects
Closest matches by what these projects do