Directory / Claude community plugins (Anthropic) / promptfoo-evals
promptfoo-evals
Teaches AI coding agents to create and maintain promptfoo eval suites. Encodes best practices like deterministic assertions first, file-based test organization, correct environment variable syntax, and proper hallucination/faithfulness checks. Includes a cheatsheet covering 30+ assertion types, provider patterns for OpenAI/Anthropic/Google/Bedrock/HTTP/Python/JS, and test patterns for JSON validation, dataset-driven scaling, and CI-friendly runs.Description from the marketplace entry / plugin manifest.
Information source
Copied from the Claude community plugins (Anthropic) catalog (anthropics/claude-plugins-community), maintained by Anthropic (community submissions).
- Marketplace entry:
.claude-plugin/marketplace.json
Links are pinned to commit 06ec7b6 (2026-10-13), the version we synced. Not reviewed by us.
Install
Add the marketplace (once, in Claude Code)
/plugin marketplace add anthropics/claude-plugins-communityIn a Claude Code session
/plugin install promptfoo-evals@claude-communityFrom your shell
claude plugin install promptfoo-evals@claude-communityCommands follow each host's documentation (Claude Code, Claude Cowork docs). gh skill needs GitHub CLI 2.90 or later and is in public preview.
Listed from Anthropic (community submissions)'s catalog, not reviewed by us. Read the source before installing.
- Catalog
- Claude community plugins (Anthropic) (
claude-community) - Information source
- marketplace.json in anthropics/claude-plugins-community
- Author
- Not stated in the source
- Source code
- promptfoo/promptfoo
- License
- MIT (repository license)
- Repository stars
- 26,443 for promptfoo/promptfoo
- Added to catalog
- 2026-04-17
- Last change
- 2026-10-26 (last push to the repo)
What it contains
Hosted in an external repository, so contents are not counted here. See the source link.
Similar in Software development
- superpowers (Claude community plugin)
- mattpocock-skills (Claude community plugin)
- ponytail (Claude community plugin)
- caveman (Claude community plugin)
- claude-mem (Claude community plugin)
- understand-anything (Claude community plugin)