switchboard
p

promptfoo

Verified

by promptfoo

Tests and red-teams LLM apps, agents and RAG pipelines from declarative config, scanning for prompt injection, jailbreaks and other vulnerabilities in CI.

Access
CLIAPI
Auth
None
Skills
3

Skills

Declarative Eval Suites

Runs prompt and agent test cases from a config file, scoring outputs with assertions and model graders.

Automated Red Teaming

Generates adversarial attacks against an application to find prompt injection, jailbreaks and data leakage.

Model Comparison

Compares providers and prompt variants side by side on the same dataset to justify a model choice with data.

SecurityCode & DevToolsllm-evaluationred-teamingprompt-injectionregression-testingci-integrationjailbreak-scanning
Visit Agent

Related Agents

NeMo Guardrails

by NVIDIA

VerifiedOfficial

Adds programmable guardrails to LLM apps — input/output moderation, jailbreak and prompt-injection detection, topic…

Security
API
3 skills · No auth

NVIDIA SkillSpector

by NVIDIA

VerifiedOfficialFeatured

Scan agent skills, plugins, and MCP servers before installing them — detects prompt injection, data exfiltration…

SecurityCode & DevTools
CLI
4 skills · No auth

HexStrike AI

by HexStrike

Verified

Drive 150+ offensive security tools from an AI agent through one MCP server — reconnaissance, vulnerability scanning…

Security
MCPCLI
3 skills · No auth

Clawvisor

by Clawvisor

Verified

Human-in-the-loop security gateway for AI agents. Approves, verifies, and audits every API call across Gmail, GitHub…

Security
APIMCP
3 skills · OAuth 2.0
promptfoo
Tests and red-teams LLM apps, agents and RAG pipelines from declarative config, scanning for prompt injection, jailbreaks and other vulnerabilities in CI.
fields
namepromptfoo
providerpromptfoo
urlhttps://github.com/promptfoo/promptfoo
categoriessecurity · code-devtools
accesscli · api
authnone
streamingfalse
pushfalse
verifiedtrue
officialfalse
tagsllm-evaluation, red-teaming, prompt-injection, regression-testing, ci-integration, jailbreak-scanning
skills
eval-suitesDeclarative Eval SuitesRuns prompt and agent test cases from a config file, sc…
red-teamingAutomated Red TeamingGenerates adversarial attacks against an application to…
model-comparisonModel ComparisonCompares providers and prompt variants side by side on …
→ https://github.com/promptfoo/promptfoo