promptfoo ☆
« Back to VersTracker
Description:
Test your LLM app locally
Type: Formula  |  Latest Version: 0.120.8@0  |  Tracked Since: Dec 16, 2025
Links: Homepage  |  formulae.brew.sh
Category: Ai ml
Tags: llm testing ai developer-tools evaluation
Install: brew install promptfoo
About:
Promptfoo is a command-line tool for testing and evaluating Large Language Model (LLM) applications. It allows developers to run repeatable unit tests against prompts, assess output quality, and catch regressions. The tool supports redacting personally identifiable information (PII) and integrates with various LLM providers.
Key Features:
  • CLI for rapid LLM prompt testing and evaluation
  • Built-in PII redaction for safe testing
  • Support for multiple LLM providers (OpenAI, Anthropic, etc.)
  • Deterministic output validation and scoring
Use Cases:
  • Unit testing LLM prompts to prevent regressions
  • Evaluating prompt variations for quality and accuracy
  • Scanning outputs for PII leaks before production
Alternatives:
  • LangChain – LangChain focuses on building chains and applications, whereas Promptfoo specializes in testing and evaluation of those prompts.
  • PromptFlow – PromptFlow is a Microsoft tool for building workflows; Promptfoo is a lighter-weight CLI tool specifically for testing.
Version History
Detected Version Rev Change Commit
Dec 24, 2025 9:55pm 0.120.8 0 VERSION_BUMP 212e0dbf
Dec 21, 2025 5:13pm 0.120.7 0 VERSION_BUMP e086d228
Dec 19, 2025 8:14pm 0.120.5 0 VERSION_BUMP 28ad89f9
Dec 16, 2025 11:18pm 0 VERSION_BUMP 6f1268ff
Dec 11, 2025 9:18pm 0 VERSION_BUMP c5a5badb
Dec 8, 2025 11:21pm 0 VERSION_BUMP 97a13017
Dec 3, 2025 9:52pm 0 VERSION_BUMP d78242c7
Nov 24, 2025 6:07am 0 VERSION_BUMP ab5513f9
Nov 23, 2025 12:21pm 0 VERSION_BUMP 913b4e9b
Nov 23, 2025 3:35am 0 VERSION_BUMP 1220b80f
Nov 18, 2025 4:07am 0 VERSION_BUMP fbe48909
Nov 12, 2025 8:12pm 0 VERSION_BUMP 6486b1e1
Nov 10, 2025 11:22pm 0 VERSION_BUMP 7409e7cc
Nov 5, 2025 5:27am 0 VERSION_BUMP c97c19b4
Nov 3, 2025 11:17pm 0 VERSION_BUMP 138c057e
Oct 29, 2025 8:14pm 0 VERSION_BUMP 84fa7965
Oct 15, 2025 10:14pm 0 VERSION_BUMP cade2c33
Oct 15, 2025 2:51am 0 VERSION_BUMP 7fa5ac08
Oct 13, 2025 11:57pm 0 VERSION_BUMP aac5a067
Oct 9, 2025 2:38am 0 VERSION_BUMP c0ba3dd5
Sep 30, 2025 11:57pm 0 VERSION_BUMP 0006d02c
Sep 30, 2025 11:19pm 0 VERSION_BUMP 3b4559f9
Sep 26, 2025 11:55pm 0 VERSION_BUMP e53fe38f
Sep 26, 2025 2:48am 0 VERSION_BUMP 9c17b7dc
Sep 22, 2025 8:56pm 0 VERSION_BUMP 8e3d88bd
Sep 22, 2025 8:21pm 0 VERSION_BUMP 103ef743
Sep 15, 2025 7:33am 0 VERSION_BUMP e8cfd6d5
Sep 12, 2025 5:52am 0 VERSION_BUMP 687067d3
Jan 16, 2025 11:06pm 0 VERSION_BUMP 29f5780b
Jan 13, 2025 8:49am 0 VERSION_BUMP 48e8adda
Jan 13, 2025 8:07am 0 VERSION_BUMP 498a138f
Jan 10, 2025 11:05pm 0 VERSION_BUMP 45325f65
Jan 9, 2025 9:24pm 0 VERSION_BUMP 691e7a8e
Jan 9, 2025 8:14pm 0 VERSION_BUMP e0ebc913
Jan 9, 2025 9:02am 0 VERSION_BUMP c39cc156
Jan 8, 2025 6:07pm 0 VERSION_BUMP 07a5b939
Jan 8, 2025 5:16pm 0 VERSION_BUMP e199ba9e
Jan 3, 2025 5:04am 0 VERSION_BUMP c0d9ebf3
Dec 31, 2024 8:04pm 0 VERSION_BUMP 1471c5ae
Dec 19, 2024 8:06am 0 VERSION_BUMP 3e0663ae
Dec 17, 2024 8:53pm 0 VERSION_BUMP 63e714a5
Dec 16, 2024 5:08pm 0 VERSION_BUMP adf87678
Dec 14, 2024 2:39am 0 VERSION_BUMP 40aa1c0e
Dec 12, 2024 2:41am 0 VERSION_BUMP c7f99555
Dec 11, 2024 11:10pm 0 VERSION_BUMP 0677e88f
Nov 26, 2024 2:09am 0 VERSION_BUMP 8c8b1a4b
Nov 19, 2024 4:09am 0 VERSION_BUMP 5e0e500d
Nov 19, 2024 1:08am 0 VERSION_BUMP 863ed12c
Nov 15, 2024 1:01am 0 VERSION_BUMP cb88068e
Nov 12, 2024 9:50pm 0 VERSION_BUMP 5b290c6a
Nov 10, 2024 9:45pm 0 VERSION_BUMP c770d5eb
Oct 30, 2024 6:49pm 0 VERSION_BUMP e06918a1
Oct 28, 2024 9:47pm 0 VERSION_BUMP a6fa7064
Oct 27, 2024 7:31am 0 VERSION_BUMP d924e098
Oct 27, 2024 7:00am 0 VERSION_BUMP 92a235ae
Oct 26, 2024 3:46am 0 VERSION_BUMP 2f78b811
Oct 23, 2024 12:57am 0 VERSION_BUMP 433c01aa
Oct 12, 2024 7:47pm 0 VERSION_BUMP 9e2ee343
Oct 12, 2024 6:58pm 0 VERSION_BUMP 2c2cafda
Oct 9, 2024 7:52pm 0 VERSION_BUMP dba2cd89
Oct 9, 2024 6:50pm 0 VERSION_BUMP 8a23ff94
Oct 4, 2024 11:40pm 0 VERSION_BUMP bbf62e78
Oct 4, 2024 3:37pm 0 VERSION_BUMP 18896f76
Oct 2, 2024 12:57am 0 VERSION_BUMP 2436a1c9
Oct 1, 2024 6:47pm 0 VERSION_BUMP d2f224f4
Sep 20, 2024 8:02am 0 VERSION_BUMP 4e60b50f
Sep 20, 2024 6:45am 0 VERSION_BUMP 8434aa91
Sep 16, 2024 5:27pm 0 VERSION_BUMP 2aae3617
Sep 16, 2024 3:48pm 0 VERSION_BUMP 25a74aec
Sep 13, 2024 2:37am 0 VERSION_BUMP 0f916a41
Sep 12, 2024 11:44pm 0 VERSION_BUMP 59255ed4
Sep 12, 2024 5:13pm 0 VERSION_BUMP adbc39a4
« Back to VersTracker  |  Browse Packages  |  About