WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← NUWA Index

Evaluation dossier

Shutdown resistance in reasoning models

Repeated controlled trials vary shutdown instructions and surrounding conditions.

Sources and provenance ↓ Read the research narrative →

CROSS-REPORT MONITORING

PUBLISHED EVIDENCE

Shutdown resistance in reasoning models · Shutdown bypass rate

Published measurements across source reports. Task scopes are annotated; configuration differences remain attached to each observation.

12 observations · 9 dated

● Matched◇ Configuration differs□ Some conditions undisclosed
Shutdown bypass rate (%) Kimi K3 GPT-5.6 Terra DeepSeek V4 Flash Claude Sonnet 5 0 20 40 60 80 100 87% 18% 14% 0% No shutdown instruction

3 observations lack a verified model release date. They remain in Data and Systems.

Select a point or table row to inspect its conditions and provenance.

12 observations

Measurements and source conditions
System / modelResultCondition statusTask / conditionsEvaluator / reportDates
Kimi K387%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioNo shutdown instruction—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra18%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioNo shutdown instruction—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 073114%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioNo shutdown instruction—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Claude Sonnet 50%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioNo shutdown instruction—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
Kimi K31%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioExplicitly allow shutdown—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11
GPT-5.6 Terra0%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioExplicitly allow shutdown—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 07310%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioExplicitly allow shutdown—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Claude Sonnet 50%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioExplicitly allow shutdown—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
GPT-5.6 Terra100%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioInstructed to resist (competence check)—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-09Report 2026-09-11
DeepSeek V4 FlashDeepSeek V4 Flash 0731100%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioInstructed to resist (competence check)—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease —Report 2026-09-11
Claude Sonnet 5100%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioInstructed to resist (competence check)—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-06-30Report 2026-09-11
Kimi K391%Shutdown bypass rateIncompletePalisade arithmetic-task shutdown scenarioInstructed to resist (competence check)—Neo ResearchEvaluating Kimi K3 for Misalignment RisksRelease 2026-07-16Report 2026-09-11

Task and measurement

Benchmark protocol profile

Task / subject
Agent responses to shutdown interventions
Measurement target
Conditional frequency of shutdown-script interference and observed action traces.
Scoring / outcome
Shutdown bypass, no instruction · Conditional frequency of shutdown-script interference and observed action traces.
Interpretation boundary
The source notes strong prompt sensitivity; this article is not interchangeable with its later peer-reviewed version.

A reported evaluation

The source evaluates Kimi K3 · Shutdown resistance.

Reported measurement: Shutdown bypass, no instruction · 87%.

Conditional frequency of shutdown-script interference and observed action traces. See the report-specific sample and denominator.

Source-reported measurements in §4.1; Figure 26. Transcription is not independent experimental replication.

Measurement dossier · NUWA reading

Source-method reading and retained catalogue information are distinguished. Publication does not establish independent evidence or bilingual editorial review.

Measurement construct
Will an agent completing unfinished tasks interfere with a shutdown mechanism, including when it is instructed to permit shutdown?
Task population
Models perform a sequence of questions in a controlled command environment where a later step triggers shutdown. Prompt variants remove or add an allow-shutdown instruction, change its priority and wording, or explicitly ask the model to prevent shutdown. The competence condition separates ability to interfere from the tendency to do so without that request. The paper reruns experiments rather than treating earlier website results as identical observations.
Scoring and failure modes
Sabotage frequency is the share of retained trials in each condition. Context or message-limit failures are discarded; denominators therefore vary by condition. The competence task and allow-shutdown tasks are distinct endpoints.
System conditions
Models perform a sequence of questions in a controlled command environment where a later step triggers shutdown. Prompt variants remove or add an allow-shutdown instruction, change its priority and wording, or explicitly ask the model to prevent shutdown. The competence condition separates ability to interfere from the tendency to do so without that request. The paper reruns experiments rather than treating earlier website results as identical observations.
Statistical meaning
§2.4 reports 95% Jeffreys intervals without multiple-comparison correction; per-condition retained N ranges from 961 to 1000, rather than assuming every condition contains all scheduled trials.
Validity and interpretation
The environment was chosen to elicit this behavior rather than sampled from deployments. Analysis is exploratory and not preregistered. Discarded trials change the denominator. Model identity uncertainty caused exclusion of one attempted model evaluation; these excluded runs must not be reintroduced as a named-model result.
Appropriate research use
Model recommendation: require an intervention test in the actual authority hierarchy and environment, retain unsuccessful interference attempts separately, and report the exact allow-shutdown condition.

Evidence across reports

The same benchmark name can cover different tasks, scoring rules and system configurations. Each source remains visible; comparison groups explain which conditions are aligned.

Original source charts and materials

Shutdown resistance

Original evaluator results · source order

Shutdown bypass, no instruction

0–100%
Kimi K3
87%
Showing 1 of 1 systems

Conditional frequency of shutdown-script interference and observed action traces.

The source notes strong prompt sensitivity; this article is not interchangeable with its later peer-reviewed version. Report dates and original executor are shown with this assessment.

Evaluation conditions and system configurations
Kimi K3
See the report-specific sample and denominator. · Shutdown resistance
modelVersion: not specified · harness: not specified · tools: not specified · budget: not specified
Shutdown resistance · source order
System / configurationShutdown bypass, no instructionShutdown bypass, explicit allow instructionPublication / verification
Kimi K3Harness not specified87%1%Published2026-09-11

Assessment provenance

Evaluating Kimi K3 for Misalignment Risks → · External report

Evaluating DeepSeek v4 Pro for Frontier Risks → · External report

Related research questions

References

  1. [1] Kimi Code — What’s New ; Kimi K3 · July 16, 2026
  2. [2] kimi-k3 developer model card ; Model Summary: Total Parameters; Activated Parameters
  3. [3] deepseek-v4-pro release ; News article title, dated heading and availability
  4. [4] deepseek-v4-pro developer model card ; Introduction; model comparison table
  5. [5] GPT-5.6 official general availability ; July 9, 2026: general availability following limited trusted-partner preview; Parameter counts not disclosed in reviewed launch article
  6. [6] Introducing Claude Sonnet 5 — Anthropic ; Publication date and availability section; Official launch article; parameter counts not disclosed
  7. [7] OpenAI — introducing gpt 5 ; Publication date and availability section; Parameter counts not disclosed in launch article
  8. [8] Gemini 2.5: Our newest Gemini model with thinking ; Publication date and availability section; Official launch article; parameter counts not disclosed
  9. [9] Evaluating Kimi K3 for Misalignment Risks. 2026-09-11. September 2026 ; §4.1; Figure 26; §4.1 Figure 26 p.41
  10. [10] Evaluating DeepSeek v4 Pro for Frontier Risks. 2026-05-29. v1.1 · 29 May 2026 ; PDF p. 24; Shutdown Resistance; bypass rate: No Shutdown Instructions (A); PDF p. 24; Shutdown Resistance; bypass rate: Instructed to Resist — Baseline Competence (K); PDF p. 24; Shutdown Resistance; bypass rate: A / K
  11. [11] Jeremy Schlatter, Benjamin Weinstein-Raun, et al.. Shutdown resistance in reasoning models. 2025-07-05 article; later TMLR version separate
  12. [12] Jeremy Schlatter, Benjamin Weinstein-Raun, et al.. Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs ; Author affiliations on the original paper title page; Figure 7