adversemed-gen
adversemed-gen is an MIT-licensed Python package that uses language models to generate adversarial medical multiple-choice questions with false premises and abstention-focused answers. It is intended for researchers evaluating calibration, hallucination, and clinical safety in LLMs.
Overview
7 featuresIn the Agent evaluation & testing space, adversemed-gen takes a focused approach. It focuses on creating adversarial medical benchmarks to test whether language models recognize uncertainty and abstain safely. adversemed-gen is an open-source project aimed at AI safety researchers and medical LLM evaluators. The project is open source (MIT). It ships for the command line, and it can be self-hosted.
calnugget builds and maintains adversemed-gen, and it first shipped in 2026. The project is developed in the open on GitHub with 9 commits in the last 90 days. Among its 7 catalogued features are question generation, medical benchmarks, and adversarial prompts.
Summary written by a language model from the project’s public pages.
- Question generation
- Medical benchmarks
- Adversarial prompts
- Abstention testing
- Calibration evaluation
- False-premise testing
- Clinical safety evaluation
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed22 Aug · 00:30 UTCadversemed-gen verified via PyPI Bulk EnumeratorSource: PyPI Bulk Enumerator · Open
Frequently asked questions about adversemed-gen
- What is adversemed-gen?
- Adversemed-gen focuses on creating adversarial medical benchmarks to test whether language models recognize uncertainty and abstain safely. It is catalogued under Agent evaluation & testing on PulseGate.
- Who should use adversemed-gen?
- adversemed-gen is an open-source project built for AI safety researchers and medical LLM evaluators.
- Does adversemed-gen have a free plan?
- Yes — adversemed-gen is open source under the MIT license and free to use.
- What platforms does adversemed-gen run on?
- adversemed-gen runs on the command line. It can also be self-hosted.
- Is adversemed-gen still maintained?
- The GitHub repository shows 9 commits in the last 90 days.
- What projects are similar to adversemed-gen?
- Similar projects tracked by PulseGate include OpenClaw Arena, numguard, and ruleprof.OpenClaw Arenanumguardruleprof
- Who makes adversemed-gen?
- adversemed-gen is developed by calnugget.
- How long has adversemed-gen been around?
- adversemed-gen first shipped in 2026.
Also in Agent evaluation & testing
Same category — not a similarity match