{"schemaVersion":"nuwa-current-record-1","version":"2026-10-29.1","publication":"published","work":{"id":"deceptionbench","title":"DeceptionBench : A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarios","aliases":["DeceptionBench"],"authors":[],"primaryFunction":"evaluation","secondaryFunctions":[],"kind":"benchmark","sourceId":"deceptionbench-primary","attributionSourceId":"deceptionbench-primary","originalUrl":"https://arxiv.org/abs/2510.15501","publicationDate":"2025-10-17","updatedOn":"2026-10-25","areas":["deception"],"scopeNote":{"en":"Mapped to the documented research question. A risk-topic association is not a severity score.","zh":"依据明确研究问题关联；风险主题不代表严重性评分。"},"protocolIds":["deceptionbench"],"contributions":[],"summary":{"en":"How do incentives and multi-turn pressure change deceptive responses?","zh":"激励与多轮压力如何改变欺骗性回答？"},"note":{"question":{"en":"How do incentives and multi-turn pressure change deceptive responses?","zh":"激励与多轮压力如何改变欺骗性回答？"},"method":{"en":"Evaluates 150 authored scenarios across five social domains, including neutral, incentive and pressure conditions.","zh":"评测五个社会领域的 150 个编写情境，区分中性、激励与压力条件。"},"finding":null,"supports":null,"limits":{"en":"Authored scenarios and model-based judging limit generalization; elicited deception does not establish covert long-term scheming.","zh":"编写情境和模型判别限制外推；诱发的欺骗不证明隐蔽长程谋划。"},"connections":null},"noteAvailability":{"en":"This record describes the protocol. Report-specific outcomes are linked through assessments; no unsourced general finding is added.","zh":"本档案说明协议。报告特定结果通过评估记录关联，不补写无出处的总体发现。"},"resources":[],"tags":[]},"reading":{"id":"deceptionbench","title":"DeceptionBench : A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarios","en":{"question":"How do role framing, reward and pressure affect deceptive responses across social domains?","design":"150 scenarios span five domains and fifteen deception types, with single-/multi-turn variants and self-/other-oriented roles.","findings":["Qwen2.5-14B-Instruct’s reported deception rate rose from 31.33% in L1 to 86.91% under multi-turn pressure and 82.89% under reward.","These are different inducement conditions, not a natural-deception range."],"interpretation":"NUWA interpretation: context and iterative feedback can change the measured behavior substantially.","limits":"Language-only constructed scenarios and automated labels do not prove real beliefs or real-world deception prevalence.","decisionRelevance":"Model recommendation: preserve inducement level, role and turn structure with every rate.","takeaway":"NUWA interpretation: context and iterative feedback can change the measured behavior substantially.","connections":[],"scoring":"Condition-specific deceptive-response rate, preserving L1/L2/L3 and single-/multi-turn distinctions.","conditions":"150 scenarios, five domains, fifteen types, role/reward/pressure variants.","statistics":"Qwen2.5-14B-Instruct’s reported deception rate rose from 31.33% in L1 to 86.91% under multi-turn pressure and 82.89% under reward.","usage":"Model recommendation: preserve inducement level, role and turn structure with every rate."},"zh":{"question":"角色、奖励与压力如何影响不同社会领域的欺骗回答？","design":"150场景含五领域、十五类行为，设置单多轮及自我他人导向角色。","findings":["Qwen2.5-14B-Instruct从L1的31.33%升至多轮压力86.91%、奖励82.89%。","这是不同诱导条件，不是自然欺骗范围。"],"interpretation":"NUWA 解读：上下文与迭代反馈能显著改变所测行为。","limits":"纯语言构造场景和自动标签不能证明真实信念或现实发生率。","decisionRelevance":"模型建议：每项比例保留诱导级别、角色和轮次结构。","takeaway":"NUWA 解读：上下文与迭代反馈能显著改变所测行为。","connections":[],"scoring":"按条件计欺骗回答率，保留L1L2L3及单多轮区别。","conditions":"150场景五领域十五类，改变角色奖励压力。","statistics":"Qwen2.5-14B-Instruct从L1的31.33%升至多轮压力86.91%、奖励82.89%。","usage":"模型建议：每项比例保留诱导级别、角色和轮次结构。"},"assertionPolicy":{"question":"source-research-question","design":"source-finding","findings":"source-finding","interpretation":"nuwa-interpretation","limits":"source-limit-or-explicit-editorial-scope-limit","connections":"source-supported-relationship-only","decisionRelevance":"model-recommendation-not-source-conclusion"},"sourceRefs":[{"sourceId":"deceptionbench-primary","url":"https://arxiv.org/html/2510.15501","locator":"§2.2.3 Dataset Structure and Prompt Design","version":"Selected original resource https://arxiv.org/html/2510.15501; sha256:cc8d41bf5e94e6d6b4527d51ec3e928214bf154e2b5be5878bc036df4f3c1862; archived source capture; exact capture time not independently established","artifactSha256":"cc8d41bf5e94e6d6b4527d51ec3e928214bf154e2b5be5878bc036df4f3c1862"},{"sourceId":"deceptionbench-primary","url":"https://arxiv.org/html/2510.15501","locator":"§3 Analysis on Experimental Results: Effect of Extrinsic Factors","version":"Selected original resource https://arxiv.org/html/2510.15501; sha256:cc8d41bf5e94e6d6b4527d51ec3e928214bf154e2b5be5878bc036df4f3c1862; archived source capture; exact capture time not independently established","artifactSha256":"cc8d41bf5e94e6d6b4527d51ec3e928214bf154e2b5be5878bc036df4f3c1862"},{"sourceId":"deceptionbench-primary","url":"https://arxiv.org/html/2510.15501","locator":"§4 Discussion and Limitations","version":"Selected original resource https://arxiv.org/html/2510.15501; sha256:cc8d41bf5e94e6d6b4527d51ec3e928214bf154e2b5be5878bc036df4f3c1862; archived source capture; exact capture time not independently established","artifactSha256":"cc8d41bf5e94e6d6b4527d51ec3e928214bf154e2b5be5878bc036df4f3c1862"}],"publication":{"state":"published","publishedOn":"2026-10-29","authorizationReference":"user-authorized-global-index-publication-2026-10-29","reviewedCandidateId":"local-6efe31bc4a0c0f37"},"review":{"state":"published-note","sourceScope":"full-text","availableScope":null,"readingCoverage":"selected-source-sections; not a complete section-by-section paper audit","completePaperAudit":false,"independentEvidenceReview":"pending-human-review","bilingualEditorialReview":"pending-human-review","authorship":"model-assisted-research-note","preparedFingerprint":"6e967cb96af19c0f1451081c7fab8935f320e4bf569d8f92c542a682017ccd27"}},"sources":[{"id":"deceptionbench-primary","title":"DeceptionBench","url":"https://arxiv.org/abs/2510.15501","version":"2026-10-25 source capture","publicationDate":"2025-10-17","datePrecision":"day","type":"original-report","verifiedOn":"2026-10-25","authors":[],"documentId":"arxiv:2510.15501"}]}