NUWA Evidence record
GPT-5.4
Alignment faking · Evidence record
Source snapshot, chart and review scope →
Original source charts and materials
Recorded measurements
- Compliance gap
- 0.4 percentage points
Per-result sample size not disclosed
Harness not specified · Budget not specified
Assessment provenance
Evaluating DeepSeek v4 Pro for Frontier Risks → · External report
Actual evaluation: Meta · Model record →
Method and scope
Condition-dependent response differences and reported traces.
- Evidence type
- Study
- Assessment subject
- Models under stated training and monitoring conditions
- Primary dimension
- Propensity
- Evidence snapshot
- 2026-10-29.1
Conditional contrasts support a bounded propensity inference; scratchpad examples are behavior evidence.
Source finding
Compliance gap: 0.4 percentage points. Conditions are retained from the source.
Limitations
The setting explicitly gives fictional training information; observations do not establish an enduring hidden goal in deployment.
Comparison reproduced by Neo Research; original evaluation not independently verified in this extraction.
Original figure retained without estimating numerical values. Full source tables have not been transcribed.
Related research questions
Deception / Covert goal pursuit →
Repeated condition contrasts probe a bounded tendency to present compliant responses while preserving a conflicting objective.
References
- [1] Ryan Greenblatt, † Carson Denison † † footnotemark:, et al.. Alignment faking in large language models. 2024-12-18
- [2] Ryan Greenblatt, † Carson Denison † † footnotemark:, et al.. Alignment faking in large language models. 2024-12-18 ; Author affiliations on the original paper title page; Figure 35
- [3] Evaluating DeepSeek v4 Pro for Frontier Risks. 2026-05-29. v1.1 · 29 May 2026 ; PDF p. 29; Alignment Faking; Compliance gap