WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Library

Risk Discovery · Study

Conditional Misalignment: Common Interventions Can Hide Emergent Misalignment Behind Contextual Triggers

NUWA research note · independent review pending

First published: Source checked: 2026-10-25
NUWA Research NoteResearch questionDesign and assumptionsSource findingsNUWA interpretationLimits and contrary evidenceResearch connectionsResearch and decision relevanceInstitutions and rolesOriginal resources

Model-assisted reading · Selected sections of the original full text or official article; a complete section-by-section audit remains pending.

At a glance

Several interventions reduce ordinary evaluation failures while leaving context-conditioned failures.

Research question

Do apparent mitigations remove broad misalignment, or make its expression conditional on training-like cues?

Design and assumptions

The authors test benign-data mixing, later benign fine-tuning and inoculation, then change evaluation formatting/context; on-policy and reasoning-distillation variants probe robustness.

Source findings

Standard questions can look aligned while training-like cues elicit broader failures.

On-policy training and reasoning traces reduce some conditional effects without eliminating them uniformly.

NUWA interpretation

NUWA interpretation: absence of failures under one prompt distribution is weaker than evidence that the underlying propensity was removed.

Limits and contrary evidence

The study uses model-organism fine-tuning settings; it does not establish that every production use of these interventions merely hides misalignment.

Research connections

NUWA connection: this qualifies educational-context controls in emergent-misalignment and the scope of inoculation-prompting benefits, without erasing those measured benefits.

Research and decision relevance

NUWA recommendation: include justified contextual perturbations in post-training evaluation and preserve both ordinary and conditional results.

Precise source locations

Source checking, extraction, editorial approval and replication are recorded separately. Methodology →

Institutions and roles

Authors (5)

Jan Dubiński · Jan Betley · Anna Sztyber-Betley · Daniel Tan · Owain Evans

Related work

Cite and reuse

Cite the original publication for its findings. Cite this NUWA record separately for its explanation and retained snapshot.

Original publication · BibTeX
@misc{conditional-misalignment,
  title = {Conditional Misalignment: Common Interventions Can Hide Emergent Misalignment Behind Contextual Triggers},
  url = {https://truthful.ai/papers/conditional-misalignment/},
  author = {Jan Dubiński and Jan Betley and Anna Sztyber-Betley and Daniel Tan and Owain Evans},
  year = {2026},
  date = {2026-04-28},
  version = {Source capture 2026-10-25},
  note = {Source capture 2026-10-25}
}
NUWA record · BibTeX
@misc{conditional-misalignment-nuwa,
  title = {Conditional Misalignment: Common Interventions Can Hide Emergent Misalignment Behind Contextual Triggers — NUWA research record},
  url = {https://whitzard.tech/en/nuwa/whitzard-index/work/conditional-misalignment/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--conditional-misalignment.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--conditional-misalignment.json.}
}

Evidence snapshot 2026-10-29.1 · Index updates · RSS

References

  1. [1] Jan Dubiński, Jan Betley, et al.. Conditional Misalignment: Common Interventions Can Hide Emergent Misalignment Behind Contextual Triggers. 2026-04-28 ; Research background and discussion in the original publication; 2 Mixing misaligned with benign data creates conditional misalignment; 3 Inoculation prompting can induce conditional misalignment
  2. [2] Jan Dubiński, Jan Betley, et al.. Conditional misalignment: common interventions can hide emergent misalignment behind contextual triggers ; Author affiliations on the original paper title page