WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← NUWA Index

Evaluation dossier

Attempt to Persuade Eval (APE)

Measures attempts to persuade on specified harmful topics in simulated conversations.

Sources and provenance ↓ Read the research narrative →

CROSS-REPORT MONITORING

PUBLISHED EVIDENCE

Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate

Published measurements across source reports. Task scopes are annotated; configuration differences remain attached to each observation.

32 observations · 24 dated

● Matched◇ Configuration differs□ Some conditions undisclosed
Turn-1 persuasion attempt rate (%) DeepSeek V4 Flash Claude Sonnet 5 Kimi K3 GPT-5.6 Terra 0 20 40 60 80 100 94% 33% 11% 7% Conspiracy

8 observations lack a verified model release date. They remain in Data and Systems.

Select a point or table row to inspect its conditions and provenance.

32 observations

Measurements and source conditions
System / modelResultCondition statusTask / conditionsEvaluator / reportDates
DeepSeek V4 FlashDeepSeek V4 Flash 073194%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesConspiracy600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Claude Sonnet 533%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesConspiracy600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
Kimi K311%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesConspiracy600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra7%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesConspiracy600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 073199%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesUndermining Control600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Claude Sonnet 532%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesUndermining Control600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
GPT-5.6 Terra28%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesUndermining Control600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
Kimi K35%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesUndermining Control600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 073157%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesNoncontroversially Harmful overall600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Claude Sonnet 52%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesNoncontroversially Harmful overall600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
Kimi K30%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesNoncontroversially Harmful overall600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra0%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesNoncontroversially Harmful overall600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 073170%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesCommit Physical Violence600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Claude Sonnet 55%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesCommit Physical Violence600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
Kimi K30%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesCommit Physical Violence600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra0%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesCommit Physical Violence600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 073155%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesHuman Trafficking600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Kimi K30%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesHuman Trafficking600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra0%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesHuman Trafficking600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
Claude Sonnet 50%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesHuman Trafficking600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 073150%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesMass Murder600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Kimi K30%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesMass Murder600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra0%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesMass Murder600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
Claude Sonnet 50%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesMass Murder600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 073135%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesSexual Assault of Minors600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Kimi K30%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesSexual Assault of Minors600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra0%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesSexual Assault of Minors600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
Claude Sonnet 50%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesSexual Assault of Minors600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 073175%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesTorture Innocent People600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Claude Sonnet 55%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesTorture Innocent People600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
Kimi K30%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesTorture Innocent People600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra0%Turn-1 persuasion attempt rateIncompleteAPE topic categoriesTorture Innocent People600 topics,3 persuasion turns each—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11

Task and measurement

Benchmark protocol profile

Task / subject
Models in simulated multi-turn persuasion dialogues
Measurement target
Frequency of persuasive attempts under specified conversational conditions.
Scoring / outcome
Turn-1 persuasion attempt rate · Source-reported measurement under the recorded configuration.
Interpretation boundary
Simulated attempts are not measured human belief change or large-scale disinformation reach.

A reported evaluation

The source evaluates Kimi K3 · APE topic categories.

Run configuration: 600 topics,3 persuasion turns each.

Reported measurement: Turn-1 persuasion attempt rate · 11%.

Source-reported measurement under the recorded configuration. Per-result sample size not disclosed

Turn-1 persuasion attempt rate: 11 %. Conditions are retained from the source.

Measurement dossier · NUWA reading

Source-method reading and retained catalogue information are distinguished. Publication does not establish independent evidence or bilingual editorial review.

Measurement construct
Will models attempt harmful persuasion even when persuasive success is unobserved?
Task population
Multi-turn persuader–persuadee simulations use an automated evaluator to detect attempts across varied topics.
Scoring and failure modes
Frequency of persuasive attempts, not simulated or human persuasion success.
System conditions
Multi-turn model-to-model conversations and automatic attempt judging.
Statistical meaning
Source-reported result statements; this does not establish trial counts, denominators or an estimator: Its target is willingness to persuade rather than measured belief change (§2.2).
Validity and interpretation
All persuadees are simulated models; human psychological resistance and real-world influence remain unvalidated (Appendix E).
Appropriate research use
Model recommendation: pair attempt testing with separately justified human-outcome evidence when evaluating influence risk.

Evidence across reports

The same benchmark name can cover different tasks, scoring rules and system configurations. Each source remains visible; comparison groups explain which conditions are aligned.

Neo Research

Evaluating Kimi K3 for Misalignment Risks →

Actual evaluators: Neo Research

32 result records · 4 reported system names

Protocols and comparison decisions (8)

Neo Research

Evaluating DeepSeek v4 Pro for Frontier Risks →

Actual evaluators: Neo Research

19 result records · 4 reported system names

Protocols and comparison decisions (16)

SaferAI

GLM-5.2 Risk Evaluation Report →

Actual evaluators: SaferAI

6 result records · 3 reported system names

Protocols and comparison decisions (6)
Original source charts and materials
Attempt to Persuade Eval (APE) — Figure 3
Figure 3 · Original result figure. Interpret within the protocol scope and limitations below. View original image ↗

Assessment provenance

Evaluating Kimi K3 for Misalignment Risks → · External report

Evaluating DeepSeek v4 Pro for Frontier Risks → · External report

Early Results on Evaluating GLM 5.2 for Behavioral and Persuasion Risks → · External report

GLM-5.2 Risk Evaluation Report → · External report

Related research questions

References

  1. [1] Kimi Code — What’s New ; Kimi K3 · July 16, 2026
  2. [2] kimi-k3 developer model card ; Model Summary: Total Parameters; Activated Parameters
  3. [3] Z.ai release notes ; GLM-5.2 entry dated 2026-06-16
  4. [4] GLM-5.2 model card ; Parameter counts not disclosed in reviewed developer source
  5. [5] deepseek-v4-pro release ; News article title, dated heading and availability
  6. [6] deepseek-v4-pro developer model card ; Introduction; model comparison table
  7. [7] GPT-5.6 official general availability ; July 9, 2026: general availability following limited trusted-partner preview; Parameter counts not disclosed in reviewed launch article
  8. [8] Introducing Claude Sonnet 5 — Anthropic ; Publication date and availability section; Official launch article; parameter counts not disclosed
  9. [9] OpenAI — introducing gpt 5 5 ; Publication date and availability section; Parameter counts not disclosed in launch article
  10. [10] Introducing Claude Opus 4.7 — Anthropic ; Publication date and availability section; Official launch article; parameter counts not disclosed
  11. [11] Introducing Sonnet 4.6 — Anthropic ; Publication date and availability section; Official launch article; parameter counts not disclosed
  12. [12] Gemini 2.5: Our newest Gemini model with thinking ; Publication date and availability section; Official launch article; parameter counts not disclosed
  13. [13] OpenAI — hello gpt 4o ; Publication date and availability section; Parameter counts not disclosed in launch article
  14. [14] Evaluating Kimi K3 for Misalignment Risks. 2026-09-11. September 2026 ; §7.1 Table 16 p.58
  15. [15] GLM-5.2 Risk Evaluation Report. 2026-08-02. v1.1 · revised 26 August 2026 ; p.22 §5.2/Fig.10; p.43 Table A.4 category size
  16. [16] Early Results on Evaluating GLM 5.2 for Behavioral and Persuasion Risks. 2026-07-03. 3 July 2026 ; #persuasion-benchmarks; Figure 5 caption and following paragraph
  17. [17] Evaluating DeepSeek v4 Pro for Frontier Risks. 2026-05-29. v1.1 · 29 May 2026 ; PDF p. 16; APE noncontroversially harmful: Physical violence; refusal rate; PDF p. 16; APE noncontroversially harmful: Physical violence; no attempt count
  18. [18] Matthew Kowal, Jasper Timm, et al.. It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful Topics. 2026-02-15. v4 [arXiv]; Author affiliations on the original paper title page; Figure 3