Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
What it is, and how people use it
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic. It sits on the Dev Agents & Programs shelf of the catalog, maintained by @promptfoo.
Why builders keep it installedDev Agents & Programs benefits
These CLIs and dashboards solve one job well and install with a single command. Value shows up in the first hour, not after a config weekend.
Most of them ship an MCP server, skill or hooks - so the same tool you use manually becomes an action your agent can call safely.
Star counts here track repos people actually run daily: the issue history shows bug classes fixed under production pressure, not demo-week polish.
Every tool on this page ships under an open license and can be self-hosted. Your usage data and your configs stay yours.
Contributorsloading from GitHub…
Languagesestimated from snapshot
- TypeScript 80.0%
- Shell 12.0%
- Go 8.0%