Keryn and Promptfoo
Promptfoo is an open source tool for LLM evals and red teaming; it agreed to be acquired by OpenAI in 2026.
Every row links the source it comes from (how these pages are written). Vendor statements quote the vendor’s own pages as read on 18 November 2026; products change, so follow the link before relying on a row. A missing row is not a claim that the vendor lacks something.
What they do
Section titled “What they do”| Claim | Source |
|---|---|
| “LLM evals run 100% locally - your prompts never leave your machine.” | Promptfoo repository |
| Code scanning for prompt injection, PII exposure and excessive agency “uses AI agents” and runs “on Promptfoo Cloud by default”. | Promptfoo code scanning |
Where they are stronger
Section titled “Where they are stronger”| Claim | Source |
|---|---|
| Tests a live application or agent with automated red teaming; Keryn analyses code and configuration. | Promptfoo |
Where Keryn differs
Section titled “Where Keryn differs”| Claim | Source |
|---|---|
| Keryn imports promptfoo configs and reaches the same verdicts: 302 configs identical, 0 differing, 115 using features Keryn does not support yet. | promptfoo receipt |
| Keryn’s code analysis is rule-based and deterministic, and runs locally. | Scores |
Measured results for Keryn are on the evaluations page, with what each one does not show.