Skip to main content
hc
Submit
toolsFirst-partyReview first Safety · Privacy ✓
Promptfoo logo

Promptfoo

Open-source prompt testing and red-teaming framework for LLM outputs, regressions, evaluations, and security checks.

by Promptfoo·added 2026-04-27·
CLI
HarnessCLI
Review first — review before installing

Open the source and read safety notes before installing.

Citation facts

Source-backed facts for citing this resource, derived directly from the registry — also available as plain text for AI assistants.

Canonical URL
https://heyclau.de/entry/tools/promptfoo
Source URLs
https://www.promptfoo.dev/docs, https://github.com/promptfoo/promptfoo, https://www.promptfoo.dev
Brand
Promptfoo
Brand domain
promptfoo.dev
Brand asset source
brandfetch
Privacy notes
Promptfoo sends your prompts and test inputs to the model providers you configure to run evals and red-team probes; review which providers are used and keep secrets out of test cases.
Author
Promptfoo
Claim status
unclaimed
Last verified
2026-04-27

Privacy notes

  • Promptfoo sends your prompts and test inputs to the model providers you configure to run evals and red-team probes; review which providers are used and keep secrets out of test cases.

Schema details

Install type
copy
Troubleshooting
No
Source repository stats
Scope
Source repo
Skill and platform metadata
Retrieval sources
https://www.promptfoo.dev/docshttps://docs.garak.ai/https://docs.confident-ai.com/
Tool listing metadata
Pricing
open-source
Disclosure
heyclaude_pick
Application category
DeveloperApplication
Operating system
macOS, Windows, Linux, Web
Full copyable content
## How Promptfoo compares

Promptfoo spans LLM testing and red-teaming; related tools in this directory differ by focus:

| Tool | Focus | Open source | Notable for |
| --- | --- | --- | --- |
| **Promptfoo** | LLM evals + red-teaming | Yes | YAML test cases, assertions, CI-friendly red-team plugins |
| **Garak** | LLM vulnerability scanning | Yes | Broad library of attack probes |
| **DeepEval** | Pytest-style LLM evals | Yes | Unit-test ergonomics and metric library |

Choose Promptfoo for combined CI evals and red-teaming; Garak for dedicated probe-based scanning, or DeepEval for pytest-native evaluation.

## Editorial notes

Promptfoo is a practical fit for teams that want repeatable prompt tests, security checks, and evaluation gates in CI.

## Disclosure

Editorial listing. No paid placement or affiliate link is used.

About this resource

How Promptfoo compares

Promptfoo spans LLM testing and red-teaming; related tools in this directory differ by focus:

Tool Focus Open source Notable for
Promptfoo LLM evals + red-teaming Yes YAML test cases, assertions, CI-friendly red-team plugins
Garak LLM vulnerability scanning Yes Broad library of attack probes
DeepEval Pytest-style LLM evals Yes Unit-test ergonomics and metric library

Choose Promptfoo for combined CI evals and red-teaming; Garak for dedicated probe-based scanning, or DeepEval for pytest-native evaluation.

Editorial notes

Promptfoo is a practical fit for teams that want repeatable prompt tests, security checks, and evaluation gates in CI.

Disclosure

Editorial listing. No paid placement or affiliate link is used.

#prompt-testing#security

Source citations

Add this badge to your README

Show that Promptfoo is listed on HeyClaude. Paste this Markdown into your README — it renders the badge and links back to this page.

Listed on HeyClaude
[![Listed on HeyClaude](https://heyclau.de/badge/tools/promptfoo.svg)](https://heyclau.de/entry/tools/promptfoo)

How it compares

Promptfoo side by side with 2 alternatives on trust, install, platform support, and disclosed safety notes — all from reviewed registry metadata.

Field
Promptfoo logoPromptfoo

Open-source prompt testing and red-teaming framework for LLM outputs, regressions, evaluations, and security checks.

Open dossier
Lakera Guard logoLakera Guard

AI security platform for detecting prompt injection, unsafe content, data leakage, and LLM application abuse.

Open dossier
Garak

Open-source LLM vulnerability scanner for probing model behavior, prompt attack surfaces, and safety failures.

Open dossier
Trust
Install riskReview firstReview firstReview first
Notes Safety · Privacy ✓ Safety · Privacy ✓ Safety · Privacy ·
BrandPromptfoo logoPromptfooLakera Guard logoLakera Guard—
Categorytoolstoolstools
Sourcefirst-partysource-backedsource-backed
AuthorPromptfooLakeraNVIDIA
Added2026-04-272026-04-272026-04-27
Platforms
CLI
CLI
CLI
Source repo———
Safety notes— missing— missing— missing
Privacy notes✓Promptfoo sends your prompts and test inputs to the model providers you configure to run evals and red-team probes; review which providers are used and keep secrets out of test cases.✓Lakera Guard inspects prompts and model outputs (sent to its API or self-hosted deployment) to detect injection, unsafe content, and data leakage; review what application traffic is sent for scanning and its data handling before routing production traffic.— missing
Prerequisites— none listed— none listed— none listed
Install———
Config———
Citations
ClaimUnclaimedUnclaimedUnclaimed

Related guides

Source-backed guides for putting this to work.

guides

Auditing MCP Client Configuration Before Team Rollout

Audit MCP client configuration before sharing it with a team.

Review firstSource-backedReview firstAdded 25d ago
Safety ✓ Privacy ✓by YB0y
guides

Auto Mode Hard-Deny Policies For Safe Automation

Set autoMode.hard_deny rules to block risky actions in auto mode.

Review firstSource-backedReview firstAdded 22d ago
Safety ✓ Privacy ✓by kiannidev
guides

Claude Code in Regulated Finance Environments

Deploy Claude Code in security-sensitive finance environments.

Review firstSource-backedReview firstAdded 8mo ago
Safety ✓ Privacy ✓by JSONbored

Signals

Loading live community signals…

More like this, weekly

A short, calm digest of reviewed Claude resources. Unsubscribe any time.