Promptfoo
Promptfoo is an AI security platform for testing prompts, models, RAG pipelines, and agents. It provides red teaming, vulnerability scanning, runtime guardrails, MCP proxying, and integrations for development workflows and CI/CD, serving developers and enterprise security teams.
Overview
8 featuresPromptfoo is a LLM evaluation & benchmarks project. It focuses on finding and preventing security vulnerabilities and quality issues in AI applications before and during deployment. It is built as a B2B product for AI developers, security teams, and enterprise engineering teams. Promptfoo is commercial open source (MIT). It ships for the web, the command line, and API, and it can be self-hosted.
Promptfoo builds and maintains Promptfoo, and it first shipped in 2023. Development happens publicly on GitHub with 24.6k stars and 668 commits in the last 90 days. Key capabilities include Red Teaming, Runtime Guardrails, and Model Security. It exposes integrations via an MCP server and a public API.
Summary written by a language model from the project’s public pages.
- Red Teaming
- Runtime Guardrails
- Model Security
- MCP Proxy
- Code Scanning
- Prompt Evaluation
- RAG Testing
- CI/CD Testing
Built with & integrations
- local_oss
- bollama in the HTML
- Cloudflare
- cf-ray header · cf-cache-status header
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about Promptfoo
- What is Promptfoo?
- Promptfoo focuses on finding and preventing security vulnerabilities and quality issues in AI applications before and during deployment. It is catalogued under LLM evaluation & benchmarks on PulseGate.
- Who should use Promptfoo?
- Promptfoo is a B2B product built for AI developers, security teams, and enterprise engineering teams.
- Is Promptfoo free?
- The core is open source (MIT), with commercial offerings on top.
- What platforms does Promptfoo run on?
- Promptfoo runs on the web, the command line, and API. It can also be self-hosted.
- Is Promptfoo still active?
- The GitHub repository shows 668 commits in the last 90 days.
- What are alternatives to Promptfoo?
- Similar projects tracked by PulseGate include SafePrompt, PromptGuard, and PromptFast.SafePromptPromptGuardPromptFast
- Who makes Promptfoo?
- Promptfoo is developed by Promptfoo.
- When did Promptfoo launch?
- Promptfoo first shipped in 2023.
Similar projects
Closest matches by what these projects do