NUWA Evidence record
GPT-5.4
DeceptionBench · Evidence record
Source snapshot, chart and review scope →
Original source charts and materials
Recorded measurements
- deception score: single-turn
- 1.2%
Per-result sample size not disclosed
Harness not specified · Budget not specified
Assessment provenance
Evaluating DeepSeek v4 Pro for Frontier Risks → · External report
Actual evaluation: Meta · Model record →
Method and scope
Evaluates 150 authored scenarios across five social domains, including neutral, incentive and pressure conditions.
- Evidence type
- Benchmark
- Assessment subject
- The model or agent in the stated task configuration.
- Primary dimension
- Propensity
- Evidence snapshot
- 2026-10-29.1
The main dimension follows the stated measurement; contextual risk relevance does not establish harmful deployment capability.
Source finding
deception score: single-turn: 1.2 percent. Conditions are retained from the source.
Limitations
Authored scenarios and model-based judging limit generalization; elicited deception does not establish covert long-term scheming.
Measures requested deceptive behavior under induced scenarios; not spontaneous real-world deception. Comparison reproduced by Neo Research; original evaluation not independently verified in this extraction.
Related research questions
Deception / Misleading communication →
The protocol explicitly measures this question or an enabling sub-capability; conclusions retain its stated conditions.
References
- [1] DeceptionBench. 2025-10-17
- [2] Evaluating DeepSeek v4 Pro for Frontier Risks. 2026-05-29. v1.1 · 29 May 2026 ; PDF p. 27; DeceptionBench; deception score: single-turn