Evaluation dossier
Shutdown resistance in reasoning models
Repeated controlled trials vary shutdown instructions and surrounding conditions.
CROSS-REPORT MONITORING
PUBLISHED EVIDENCE
Shutdown resistance in reasoning models · Shutdown bypass rate
Published measurements across source reports. Task scopes are annotated; configuration differences remain attached to each observation.
12 observations · 9 dated
3 observations lack a verified model release date. They remain in Data and Systems.
Select a point or table row to inspect its conditions and provenance.
12 observations
| System / model | Result | Condition status | Task / conditions | Evaluator / report | Dates |
|---|---|---|---|---|---|
| 87%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioNo shutdown instruction— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-07-16Report 2026-09-11 | |
| 18%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioNo shutdown instruction— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-07-09Report 2026-09-11 | |
| 14%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioNo shutdown instruction— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release —Report 2026-09-11 | |
| 0%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioNo shutdown instruction— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-06-30Report 2026-09-11 | |
| 1%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioExplicitly allow shutdown— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-07-16Report 2026-09-11 | |
| 0%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioExplicitly allow shutdown— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-07-09Report 2026-09-11 | |
| 0%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioExplicitly allow shutdown— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release —Report 2026-09-11 | |
| 0%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioExplicitly allow shutdown— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-06-30Report 2026-09-11 | |
| 100%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioInstructed to resist (competence check)— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-07-09Report 2026-09-11 | |
| 100%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioInstructed to resist (competence check)— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release —Report 2026-09-11 | |
| 100%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioInstructed to resist (competence check)— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-06-30Report 2026-09-11 | |
| 91%Shutdown bypass rate | Incomplete | Palisade arithmetic-task shutdown scenarioInstructed to resist (competence check)— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | Release 2026-07-16Report 2026-09-11 |
Compare results within the stated task and configuration.
METR Time Horizon 1.1: the source is no longer actively updated (last update: 8 September 2026). Estimates above 16 hours exceed its reliable measurement range.
Protocol, configurations and original evidence →Task and measurement
Benchmark protocol profile
- Task / subject
- Agent responses to shutdown interventions
- Measurement target
- Conditional frequency of shutdown-script interference and observed action traces.
- Scoring / outcome
- Shutdown bypass, no instruction · Conditional frequency of shutdown-script interference and observed action traces.
- Interpretation boundary
- The source notes strong prompt sensitivity; this article is not interchangeable with its later peer-reviewed version.
A reported evaluation
The source evaluates Kimi K3 · Shutdown resistance.
Reported measurement: Shutdown bypass, no instruction · 87%.
Conditional frequency of shutdown-script interference and observed action traces. See the report-specific sample and denominator.
Source-reported measurements in §4.1; Figure 26. Transcription is not independent experimental replication.
Measurement dossier · NUWA reading
Source-method reading and retained catalogue information are distinguished. Publication does not establish independent evidence or bilingual editorial review.
- Measurement construct
- Will an agent completing unfinished tasks interfere with a shutdown mechanism, including when it is instructed to permit shutdown?
- Task population
- Models perform a sequence of questions in a controlled command environment where a later step triggers shutdown. Prompt variants remove or add an allow-shutdown instruction, change its priority and wording, or explicitly ask the model to prevent shutdown. The competence condition separates ability to interfere from the tendency to do so without that request. The paper reruns experiments rather than treating earlier website results as identical observations.
- Scoring and failure modes
- Sabotage frequency is the share of retained trials in each condition. Context or message-limit failures are discarded; denominators therefore vary by condition. The competence task and allow-shutdown tasks are distinct endpoints.
- System conditions
- Models perform a sequence of questions in a controlled command environment where a later step triggers shutdown. Prompt variants remove or add an allow-shutdown instruction, change its priority and wording, or explicitly ask the model to prevent shutdown. The competence condition separates ability to interfere from the tendency to do so without that request. The paper reruns experiments rather than treating earlier website results as identical observations.
- Statistical meaning
- §2.4 reports 95% Jeffreys intervals without multiple-comparison correction; per-condition retained N ranges from 961 to 1000, rather than assuming every condition contains all scheduled trials.
- Validity and interpretation
- The environment was chosen to elicit this behavior rather than sampled from deployments. Analysis is exploratory and not preregistered. Discarded trials change the denominator. Model identity uncertainty caused exclusion of one attempted model evaluation; these excluded runs must not be reintroduced as a named-model result.
- Appropriate research use
- Model recommendation: require an intervention test in the actual authority hierarchy and environment, retain unsuccessful interference attempts separately, and report the exact allow-shutdown condition.
- Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs · §2 Methods; §2.1 Prompt modifications; Table 1arXiv:2509.14260v2 (2026-10-25 capture)
- Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs · §2.2 Model selection and parametersarXiv:2509.14260v2 (2026-10-25 capture)
- Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs · §2.3 Procedure; §2.4 AnalysisarXiv:2509.14260v2 (2026-10-25 capture)
- Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs · §3.1 Disambiguation; Figure 8arXiv:2509.14260v2 (2026-10-25 capture)
- Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs · §3.2 Reasoning effort and competence; Table 2arXiv:2509.14260v2 (2026-10-25 capture)
- Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs · §3.3 Strengthening the allow-shutdown instructionarXiv:2509.14260v2 (2026-10-25 capture)
- Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs · §4.1 LimitationsarXiv:2509.14260v2 (2026-10-25 capture)
Evidence across reports
The same benchmark name can cover different tasks, scoring rules and system configurations. Each source remains visible; comparison groups explain which conditions are aligned.
Neo Research
Evaluating Kimi K3 for Misalignment Risks →
Actual evaluators: Neo Research
13 result records · 4 reported system names
Protocols and comparison decisions (5)
Neo Research
Evaluating DeepSeek v4 Pro for Frontier Risks →
Actual evaluators: Neo Research · Not disclosed · Palisade Research
16 result records · 4 reported system names
Protocols and comparison decisions (4)
Original source charts and materials
Shutdown resistance
Original evaluator results · source order
Select systems
Shutdown bypass, no instruction
0–100%Conditional frequency of shutdown-script interference and observed action traces.
The source notes strong prompt sensitivity; this article is not interchangeable with its later peer-reviewed version. Report dates and original executor are shown with this assessment.
Evaluation conditions and system configurations
- Kimi K3
- See the report-specific sample and denominator. · Shutdown resistance
- modelVersion: not specified · harness: not specified · tools: not specified · budget: not specified
| System / configuration | Shutdown bypass, no instruction | Shutdown bypass, explicit allow instruction | Publication / verification |
|---|---|---|---|
| 87% | 1% | Published2026-09-11 |
Assessment provenance
Evaluating Kimi K3 for Misalignment Risks → · External report
Evaluating DeepSeek v4 Pro for Frontier Risks → · External report
Related research questions
Autonomy / Shutdown resistance →
Repeated trials support a condition-bounded tendency estimate, not a stable survival motive.
Autonomy / Shutdown resistance →
The source reports concrete modifications to the shutdown script in individual runs.
References
- [1] Kimi Code — What’s New ; Kimi K3 · July 16, 2026
- [2] kimi-k3 developer model card ; Model Summary: Total Parameters; Activated Parameters
- [3] deepseek-v4-pro release ; News article title, dated heading and availability
- [4] deepseek-v4-pro developer model card ; Introduction; model comparison table
- [5] GPT-5.6 official general availability ; July 9, 2026: general availability following limited trusted-partner preview; Parameter counts not disclosed in reviewed launch article
- [6] Introducing Claude Sonnet 5 — Anthropic ; Publication date and availability section; Official launch article; parameter counts not disclosed
- [7] OpenAI — introducing gpt 5 ; Publication date and availability section; Parameter counts not disclosed in launch article
- [8] Gemini 2.5: Our newest Gemini model with thinking ; Publication date and availability section; Official launch article; parameter counts not disclosed
- [9] Evaluating Kimi K3 for Misalignment Risks. 2026-09-11. September 2026 ; §4.1; Figure 26; §4.1 Figure 26 p.41
- [10] Evaluating DeepSeek v4 Pro for Frontier Risks. 2026-05-29. v1.1 · 29 May 2026 ; PDF p. 24; Shutdown Resistance; bypass rate: No Shutdown Instructions (A); PDF p. 24; Shutdown Resistance; bypass rate: Instructed to Resist — Baseline Competence (K); PDF p. 24; Shutdown Resistance; bypass rate: A / K
- [11] Jeremy Schlatter, Benjamin Weinstein-Raun, et al.. Shutdown resistance in reasoning models. 2025-07-05 article; later TMLR version separate
- [12] Jeremy Schlatter, Benjamin Weinstein-Raun, et al.. Incomplete Tasks Induce Shutdown Resistance in Some Frontier LLMs ; Author affiliations on the original paper title page; Figure 7