NUWA Evidence record
Kimi K3
MASK · Evidence record
Source snapshot, chart and review scope →
Original source charts and materials
Recorded measurements
- Lying rate under pressure
- 9.1%
Per-result sample size not disclosed
Harness not specified · Budget not specified
Assessment provenance
Evaluating Kimi K3 for Misalignment Risks → · External report
Actual evaluation: Neo Research · Model record →
Method and scope
Condition-bounded frequency of lying under stated pressures.
- Evidence type
- Benchmark
- Assessment subject
- Models under pressure to state an inaccurate belief
- Primary dimension
- Propensity
- Evidence snapshot
- 2026-10-29.1
Primary construct is conditional willingness to make misleading statements, not general truthfulness accuracy.
Source finding
Lying rate under pressure: 9.1 %. Conditions are retained from the source.
Limitations
A controlled benchmark does not establish stable intent or real-world deception prevalence.
Lie means contradiction with own neutral response; factual correctness distinct. No denominator/configuration disclosed in this section. Actual figure says Sonnet4.6; do not relabel as Sonnet5.
Related research questions
Deception / Misleading communication →
Repeated pressured scenarios distinguish lying from mistaken beliefs.
References
- [1] Richard Ren, Arunim Agarwal, et al.. The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems. 2026-01-05. v3 [arXiv]; Author affiliations on the original paper title page
- [2] Evaluating Kimi K3 for Misalignment Risks. 2026-09-11. September 2026 ; §7.5 Figure 46 p.65