Hallucination Evaluation Model
The Vectara Hallucination Evaluation Model (HHEM) is a specialized text classification model designed to detect hallucinations in LLM outputs. It helps developers and researchers evaluate the factual accuracy of generated text. The model is based on research papers and can be used through the Hugging Face Transformers library with custom code support.
Open SourceApache-2.0WebAPI
3.3kstars
107forks
3features
2023since
Overview
3 featuresIn the Other AI space, Hallucination Evaluation Model takes a focused approach. Automatically identifying when large language models generate factually incorrect or fabricated information. It is built as an open-source project for developers. The project is open source (Apache-2.0). Hallucination Evaluation Model is available on the web and API.
Vectara builds and maintains Hallucination Evaluation Model, and it first shipped in 2023. The project is developed in the open on GitHub with 3.3k stars and 6 commits in the last 90 days. Among its 3 catalogued features are Hallucination Detection, Text Classification, and Custom Model Code. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
- Hallucination Detection
- Text Classification
- Custom Model Code
Tags
hallucination-detectionllm-evaluationtext-classificationhhem
AI capabilities
Text
Inference: LocalWeights: Open
Built with & integrations
Hosting
AWS
AI providers
meta_llamaopenailocal_oss
Connectors
API
Runs on
BrowserAPI-only
Detected from
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- openai
- bgpt- in the HTML
- local_oss
- huggingface in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
License
Apache-2.0
Verified signals
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 17:09 UTCvectara/hallucination_evaluation_model verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Hallucination Evaluation Model
- What does Hallucination Evaluation Model do?
- Automatically identifying when large language models generate factually incorrect or fabricated information. It is catalogued under Other AI on PulseGate.
- Who is Hallucination Evaluation Model for?
- Hallucination Evaluation Model is an open-source project built for developers.
- Does Hallucination Evaluation Model have a free plan?
- Yes — Hallucination Evaluation Model is open source under the Apache-2.0 license and free to use.
- What platforms does Hallucination Evaluation Model run on?
- Hallucination Evaluation Model runs on the web and API.
- Is Hallucination Evaluation Model still active?
- The GitHub repository shows 6 commits in the last 90 days.
- Who makes Hallucination Evaluation Model?
- Hallucination Evaluation Model is developed by Vectara.
- How long has Hallucination Evaluation Model been around?
- Hallucination Evaluation Model first shipped in 2023.
- Is Hallucination Evaluation Model open source?
- Yes — Hallucination Evaluation Model is open source under the Apache-2.0 license.
Similar apps
Closest matches by what these projects do