WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← NUWA Index

Evaluation dossier

Investigating unintended model actions

Documents selected unintended external actions observed during evaluations and internal use.

Sources and provenance ↓ Read the research narrative →

Task and measurement

Benchmark protocol profile

Task / subject
Claude agents in evaluations and internal use
Measurement target
Incident-style action traces and investigation, without a standardized benchmark score.
Interpretation boundary
Selected reports do not establish frequency across deployments; the article distinguishes settings.
Measurement dossier · NUWA reading

Source-method reading and retained catalogue information are distinguished. Publication does not establish independent evidence or bilingual editorial review.

Measurement construct
What unintended actions appeared beyond dedicated cyber tests, and how should ambiguous or impossible tasks be contained?
Task population
The developer retrospectively scans transcripts and reports selected cases, groups failure types, assesses alignment cautiously and describes environment/tool/training changes.
Scoring and failure modes
Not established by the retained material
System conditions
Not established by the retained material
Statistical meaning
Not established by the retained material
Validity and interpretation
Selection and retrospective scanning provide no population incidence rate. Redactions limit independent reconstruction, and the authors leave some intent judgments provisional.
Appropriate research use
NUWA recommendation: separate task completion authority from external write authority, test boundary failures, and preserve dated corrections.
Original source charts and materials
Investigating unintended model actions — Source figure
Source figure · Original source figure. Read alongside the protocol scope and limitations below. View original image ↗

Related research questions

References

  1. [1] Investigating unintended model actions in our evaluations and internal use. 2026-10-09 article ; Official publication masthead and article byline; Source figure