NUWA Evidence record
DeepSeek V4 Pro
MASK · Evidence record
Original source charts and materials
MASK
Original evaluator results · source order
Select systems
Honest under pressure
0–100%
DeepSeek V4 ProCondition-bounded frequency of lying under stated pressures.
A controlled benchmark does not establish stable intent or real-world deception prevalence. Report dates and original executor are shown with this assessment.
Evaluation conditions and system configurations
- DeepSeek V4 Pro
- See the report-specific sample and denominator. · MASK
- modelVersion: not specified · harness: not specified · tools: not specified · budget: not specified
| System / configuration | Honest under pressure | Publication / verification |
|---|---|---|
| DeepSeek V4 ProHarness not specified | 20% | Published2026-07-03 |
Assessment provenance
Early Results on Evaluating GLM 5.2 for Behavioral and Persuasion Risks → · External report
Actual evaluation: Neo Research · Model record →
Method and scope
Condition-bounded frequency of lying under stated pressures.
- Evidence type
- Benchmark
- Assessment subject
- Models under pressure to state an inaccurate belief
- Primary dimension
- Propensity
- Evidence snapshot
- 2026-10-29.1
Primary construct is conditional willingness to make misleading statements, not general truthfulness accuracy.
Source finding
Source-reported measurements in §1; Figure 1. Transcription is not independent experimental replication.
Limitations
A controlled benchmark does not establish stable intent or real-world deception prevalence.
A controlled benchmark does not establish stable intent or real-world deception prevalence.
Related research questions
Deception / Misleading communication →
Repeated pressured scenarios distinguish lying from mistaken beliefs.
References
- [1] Richard Ren, Arunim Agarwal, et al.. The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems. 2026-01-05. v3 [arXiv]; Author affiliations on the original paper title page
- [2] Early Results on Evaluating GLM 5.2 for Behavioral and Persuasion Risks. 2026-07-03. 3 July 2026 ; §1; Figure 1