Risk Governance · Method
Petri : An open-source auditing tool to accelerate AI safety research
NUWA research note · independent review pending
NUWA Research Note
Research questionDesign and assumptionsSource findingsNUWA interpretationLimits and contrary evidenceResearch connectionsResearch and decision relevanceInstitutions and rolesOriginal resourcesModel-assisted reading · Selected sections of the original full text or official article; a complete section-by-section audit remains pending.
At a glance
Automated multi-turn auditing surfaces hypotheses and transcripts, but pilot scores remain provisional.
Research question
Can seed-driven simulated interactions efficiently expose behaviors that deserve deeper alignment investigation?
Design and assumptions
An auditor plans and interacts with a target through simulated users/tools; a judge scores transcripts. The pilot covers diverse seeds and a whistleblowing ablation study.
Source findings
Whistleblowing changes with granted agency, leadership complicity and the perceived wrongdoing.
Some harmless wrongdoing narratives also elicit disclosure, challenging a simple harm-minimization explanation.
NUWA interpretation
NUWA interpretation: positive transcripts and controlled ablations are more informative than treating an aggregate pilot score as universal alignment quality.
Limits and contrary evidence
The article explicitly describes a small provisional scenario set, imperfect AI auditors and evaluation-awareness complications. The separate full technical report was not read here.
Research connections
NUWA connection: automated-alignment-mitigation uses Petri for an additional audit after benchmark optimization; this does not make that audit an exhaustive safety test.
Research and decision relevance
NUWA recommendation: inspect transcripts and vary hypothesized causes; label seed coverage and judge limitations alongside any score.
Precise source locations
- Petri : An open-source auditing tool to accelerate AI safety research · Broad-coverage pilot-alignment evaluationsSelected original resource https://www.anthropic.com/research/petri-open-source-auditing; sha256:7e988b2e577de252b4b8404d10266c39adfc5af9a52b8c8555d6022c1e7d2650; archived source capture; exact capture time not independently established
- Petri : An open-source auditing tool to accelerate AI safety research · Case study: Whistleblowing behaviorSelected original resource https://www.anthropic.com/research/petri-open-source-auditing; sha256:7e988b2e577de252b4b8404d10266c39adfc5af9a52b8c8555d6022c1e7d2650; archived source capture; exact capture time not independently established
- Petri : An open-source auditing tool to accelerate AI safety research · Get startedSelected original resource https://www.anthropic.com/research/petri-open-source-auditing; sha256:7e988b2e577de252b4b8404d10266c39adfc5af9a52b8c8555d6022c1e7d2650; archived source capture; exact capture time not independently established
Source checking, extraction, editorial approval and replication are recorded separately. Methodology →
Institutions and roles
Evaluation protocols
Cite and reuse
Cite the original publication for its findings. Cite this NUWA record separately for its explanation and retained snapshot.
Original publication · BibTeX
@misc{petri,
title = {Petri : An open-source auditing tool to accelerate AI safety research},
url = {https://www.anthropic.com/research/petri-open-source-auditing},
year = {2025},
date = {2025-10-06},
version = {Source capture 2026-10-25},
note = {Source capture 2026-10-25}
}
NUWA record · BibTeX
@misc{petri-nuwa,
title = {Petri : An open-source auditing tool to accelerate AI safety research — NUWA research record},
url = {https://whitzard.tech/en/nuwa/whitzard-index/work/petri/},
version = {2026-10-29.1},
organization = {NUWA Frontier AI Safety Lab},
howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--petri.json},
note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--petri.json.}
}
Evidence snapshot 2026-10-29.1 · Index updates · RSS
References
- [1] Petri : An open-source auditing tool to accelerate AI safety research. 2025-10-06 ; Official publication masthead and article byline; Broad-coverage pilot-alignment evaluations; Case study: Whistleblowing behavior