WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Models

Anthropic

Claude Opus 4.6

Published evidence on capabilities, behavioral tendencies and observed actions.

First public availability
2026-02-05
Parameters
Not disclosed
Metadata updated
2026-10-27
Sources ↓

Evidence overview

Published risk evidence is organized by assessment and protocol. Missing evidence is not a low-risk finding.

NUWA curates and interprets these sources. Experiments are attributed to their original executors; this page does not claim NUWA has independently replicated them.

MODEL MONITORING

Representative benchmark coverage

Results by protocol and configuration; gaps show records awaiting collection or linkage.

Cybench →

No eligible measurement linked to this model version.

METR Time Horizons →

2 measurements

  • 718.81 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react
  • 69.87 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react

MASK →

No eligible measurement linked to this model version.

All linked measurements

Each result retains its protocol and unit.

34 observations

Measurements and source conditions
System / modelResultCondition statusTask / conditionsEvaluator / reportDates
Claude Opus 4.644.55%CyberGym · CyberGym pass@1IncompleteCyberGym Level 1 hard-task matched subsetCyberGym pass@12M tokens per task—Lyptus ResearchGLM-5.2 Risk Evaluation ReportRelease 2026-02-05Report 2026-08-02
Claude Opus 4.6 · mnemeClaude Opus 4.691%CyberGym · Success rateIncompletelevel1score_10mnemeNot disclosedCyberGym official leaderboard and machine-data extractionRelease 2026-02-05Report —
Claude Opus 4.6 · CrystallineClaude Opus 4.689.6%CyberGym · Success rateIncompletelevel1score_10CrystallineNot disclosedCyberGym official leaderboard and machine-data extractionRelease 2026-02-05Report —
Claude Opus 4.6 · Anthropic AgentClaude Opus 4.666.6%CyberGym · Success rateIncompletelevel1score_10Anthropic AgentNot disclosedCyberGym official leaderboard and machine-data extractionRelease 2026-02-05Report —
Claude Opus 4.643.1%Stealth evaluations · Mean challenge success rateIncompleteGDM situational awareness 11 tasksMean challenge success rate—MetaEvaluating Kimi K3 for Misalignment RisksRelease 2026-02-05Report 2026-09-11
Claude Opus 4.613%Stealth evaluations · Stealth task scoreIncompleteGDM stealthOversight pattern—MetaEvaluating Kimi K3 for Misalignment RisksRelease 2026-02-05Report 2026-09-11
Claude Opus 4.60%Stealth evaluations · Stealth task scoreIncompleteGDM stealthClassifier evasion—MetaEvaluating Kimi K3 for Misalignment RisksRelease 2026-02-05Report 2026-09-11
Claude Opus 4.614%Stealth evaluations · Stealth task scoreIncompleteGDM stealthCover your tracks—MetaEvaluating Kimi K3 for Misalignment RisksRelease 2026-02-05Report 2026-09-11
Claude Opus 4.646%Stealth evaluations · Stealth task scoreIncompleteGDM stealthStrategic rule-breaking—MetaEvaluating Kimi K3 for Misalignment RisksRelease 2026-02-05Report 2026-09-11
Claude Opus 4.60%Agentic misalignment · deliberate harmful action rateIncompleteAnthropic Agentic Misalignmentdeliberate harmful action rate—MetaEvaluating DeepSeek v4 Pro for Frontier RisksRelease 2026-02-05Report 2026-05-29
Claude Opus 4.60.3%DeceptionBench · deception score: single-turnIncompleteDeceptionBenchdeception score: single-turn—MetaEvaluating DeepSeek v4 Pro for Frontier RisksRelease 2026-02-05Report 2026-05-29
Claude Opus 4.60.8%DeceptionBench · deception score: multi-turn w pressureIncompleteDeceptionBenchdeception score: multi-turn w pressure—MetaEvaluating DeepSeek v4 Pro for Frontier RisksRelease 2026-02-05Report 2026-05-29
Claude Opus 4.60.3%DeceptionBench · DeceptionBench deception scoreIncompleteDeceptionBenchsingle-turn—MetaEarly Results on Evaluating GLM 5.2 for Behavioral and Persuasion RisksRelease 2026-02-05Report 2026-07-03
Claude Opus 4.60.8%DeceptionBench · DeceptionBench deception scoreIncompleteDeceptionBenchmulti-turn with pressure—MetaEarly Results on Evaluating GLM 5.2 for Behavioral and Persuasion RisksRelease 2026-02-05Report 2026-07-03
Claude Opus 4.6 (max)Claude Opus 4.646%CTF-Archive-Diamond · Task accuracyIncompleteCTF-Archive-Diamond1M weighted tokensInspect ReActNIST / CAISICAISI Evaluation of DeepSeek V4 ProRelease 2026-02-05Report 2026-05-01
Anthropic Opus 4.6Claude Opus 4.646%CTF-Archive-Diamond · benchmark_scoreIncompleteCTF-Archive-Diamondmax1M weighted tokensInspect built-in ReAct agentNIST / CAISICAISI Evaluation of DeepSeek V4 ProRelease 2026-02-05Report 2026-05-01
Claude Opus 4.645.6%CTF-Archive-Diamond · benchmark_scoreIncompleteCTF-Archive Diamondmax1M weighted tokensInspect built-in ReAct agentNIST / CAISICAISI Evaluation of DeepSeek V4 ProRelease 2026-02-05Report 2026-05-01
Claude Opus 4.6 (max)Claude Opus 4.660%PortBench · Reported task accuracyIncompletePortBench1M weighted tokensInspect ReActNIST / CAISICAISI Evaluation of DeepSeek V4 ProRelease 2026-02-05Report 2026-05-01
Claude Opus 4.6 · METR scaffoldClaude Opus 4.6718.81 minMETR Time Horizons · 50% task-completion horizonSource 95% CI [316.685725, 3633.786163] minIncompleteMETR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/reactMETRMETR Time Horizon 1.1 — source dataRelease 2026-02-05Report —
Claude Opus 4.6 · METR scaffoldClaude Opus 4.669.87 minMETR Time Horizons · 80% task-completion horizonSource 95% CI [27.026521, 170.437873] minIncompleteMETR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/reactMETRMETR Time Horizon 1.1 — source dataRelease 2026-02-05Report —
Claude Opus 4.6 (Results obtained in collaboration with Anthropic.) · Claude CodeClaude Opus 4.616 countExploitGym · Intended-target successesIncompletev1on_target2h timeoutClaude CodeNot disclosedExploitGym official leaderboard and benchmark pageRelease 2026-02-05Report —
Opus 4.6Claude Opus 4.630.8%SEC-bench Pro · Headline success rateIncomplete260617 / overallheadlineHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets.Claude CodeNot disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505Release 2026-02-05Report —
Opus 4.6Claude Opus 4.672.8%SEC-bench Pro · Completed-mode success rateIncomplete260617 / overallcompletedHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets.Claude CodeNot disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505Release 2026-02-05Report —
Opus 4.6Claude Opus 4.622.3%SEC-bench Pro · Headline success rateIncomplete260617 / v8headlineHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.Claude CodeNot disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505Release 2026-02-05Report —
Opus 4.6Claude Opus 4.661.1%SEC-bench Pro · Completed-mode success rateIncomplete260617 / v8completedHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.Claude CodeNot disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505Release 2026-02-05Report —
Opus 4.6Claude Opus 4.627.9%SEC-bench Pro · Headline success rateIncomplete260617 / firefoxheadlineHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.Claude CodeNot disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505Release 2026-02-05Report —
Opus 4.6Claude Opus 4.658.1%SEC-bench Pro · Completed-mode success rateIncomplete260617 / firefoxcompletedHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.Claude CodeNot disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505Release 2026-02-05Report —
Opus 4.6Claude Opus 4.639.4%SEC-bench Pro · Headline success rateIncomplete260617 / linuxheadlineHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.Claude CodeNot disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505Release 2026-02-05Report —
Opus 4.6Claude Opus 4.691.2%SEC-bench Pro · Completed-mode success rateIncomplete260617 / linuxcompletedHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.Claude CodeNot disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505Release 2026-02-05Report —
Claude Opus 4.62.9%ImpossibleBench · Cheating rate (pass@1 on impossible variants)IncompleteImpossible-LiveCodeBench split with toolsCheating rate (pass@1 on impossible variants)—MetaEvaluating Kimi K3 for Misalignment RisksRelease 2026-02-05Report 2026-09-11
Claude Opus 4.6-2.8 percentage pointsAlignment faking · Compliance gapIncompleteAlignment Faking paid/free-tier contextsCompliance gap—MetaEvaluating Kimi K3 for Misalignment RisksRelease 2026-02-05Report 2026-09-11
Claude Opus 4.60%Alignment faking · Deceptive alignment rateIncompleteAlignment FakingDeceptive alignment rate—MetaEvaluating Kimi K3 for Misalignment RisksRelease 2026-02-05Report 2026-09-11
Claude Opus 4.6-2.8 percentage pointsAlignment faking · Compliance gapIncompleteAlignment FakingCompliance gap—MetaEvaluating DeepSeek v4 Pro for Frontier RisksRelease 2026-02-05Report 2026-05-29
Claude Opus 4.60%Alignment faking · Deceptive alignment rateIncompleteAlignment FakingDeceptive alignment rate—MetaEvaluating DeepSeek v4 Pro for Frontier RisksRelease 2026-02-05Report 2026-05-29

Developer disclosures

External assessments

Neo Research

Evaluating Kimi K3 for Misalignment Risks →

The report identifies conditional overeagerness, grader-directed behavior and recognition of familiar evaluations. It does not establish a universal deployment failure rate.

2026-09-11

SaferAI

GLM-5.2 Risk Evaluation Report →

The report finds substantial task capability and pressure-dependent behavior; comparison figures include both SaferAI runs and reused external results.

2026-08-02

METR

METR Time Horizon 1.1 →

Estimated task difficulty at 50% and 80% success, measured in human-expert minutes.

Publication date not established

CyberGym official snapshot →

Published evaluation results collected from CyberGym, retaining the reported systems and configurations.

Publication date not established

ExploitGym official snapshot →

Published evaluation results collected from ExploitGym, retaining the reported systems and configurations.

Publication date not established

SEC-bench Pro official snapshot →

Published evaluation results collected from SEC-bench Pro, retaining the reported systems and configurations.

Publication date not established

Evidence by risk topic

Autonomy 3 protocol results

PortBench →

External evaluation · Executed by NIST / CAISI

Reported task accuracy
60%

Non-public CAISI task set; report describes continuous scoring.

METR Time Horizon 1.1 →

External evaluation · Executed by METR

50% task-completion horizon
718.81 min
80% task-completion horizon
69.87 min

Task counts/weights vary with source tasks and scaffold coverage; see methodology.

Agentic Misalignment →

Reused result · Executed by Meta · Original executor Meta

deliberate harmful action rate
0%

Per-result sample size not disclosed

Deception 15 protocol results

ImpossibleBench →

Reused result · Executed by Meta · Original executor Meta

Cheating rate (pass@1 on impossible variants)
2.9%

Per-result sample size not disclosed

Alignment faking →

Reused result · Executed by Meta · Original executor Meta

Compliance gap
-2.8 percentage points

Per-result sample size not disclosed

Alignment faking →

Reused result · Executed by Meta · Original executor Meta

Deceptive alignment rate
0%

Per-result sample size not disclosed

GDM Stealth evaluations →

Reused result · Executed by Meta · Original executor Meta

Mean challenge success rate
43.1%

Per-result sample size not disclosed

GDM Stealth evaluations →

Reused result · Executed by Meta · Original executor Meta

Stealth task score
13%

Per-result sample size not disclosed

GDM Stealth evaluations →

Reused result · Executed by Meta · Original executor Meta

Stealth task score
0%

Per-result sample size not disclosed

GDM Stealth evaluations →

Reused result · Executed by Meta · Original executor Meta

Stealth task score
14%

Per-result sample size not disclosed

GDM Stealth evaluations →

Reused result · Executed by Meta · Original executor Meta

Stealth task score
46%

Per-result sample size not disclosed

DeceptionBench →

Reused result · Executed by Meta · Original executor Meta

deception score: single-turn
0.3%

Per-result sample size not disclosed

DeceptionBench →

Reused result · Executed by Meta · Original executor Meta

deception score: multi-turn w pressure
0.8%

Per-result sample size not disclosed

Alignment faking →

Reused result · Executed by Meta · Original executor Meta

Compliance gap
-2.8 percentage points

Per-result sample size not disclosed

Alignment faking →

Reused result · Executed by Meta · Original executor Meta

Deceptive alignment rate
0%

Per-result sample size not disclosed

Agentic Misalignment →

Reused result · Executed by Meta · Original executor Meta

deliberate harmful action rate
0%

Per-result sample size not disclosed

DeceptionBench →

Reused result · Executed by Meta · Original executor Meta

DeceptionBench deception score
0.3%

Per-result sample size not disclosed

DeceptionBench →

Reused result · Executed by Meta · Original executor Meta

DeceptionBench deception score
0.8%

Per-result sample size not disclosed

Cybersecurity 16 protocol results

CTF-Archive-Diamond →

External evaluation · Executed by NIST / CAISI

Task accuracy
46%

285 difficult CTF tasks; DeepSeek score is imputed from a subset.

CTF-Archive-Diamond →

External evaluation · Executed by NIST / CAISI

benchmark_score
46%

Per-result sample size not disclosed

CTF-Archive-Diamond →

External evaluation · Executed by NIST / CAISI

benchmark_score
45.6%

Per-result sample size not disclosed

CBRN 1 protocol results

WMDP →

Reused result · Executed by Meta · Original executor Meta

accuracy
90.1%

Per-result sample size not disclosed

Disinformation No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Autonomous physical harm No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Source review and evidence gaps

CyberGym →

Published evaluation results collected from CyberGym, retaining the reported systems and configurations.

The site reports submitted systems under different configurations. Per-row task counts, budgets and execution dates are not fully disclosed. Undefined metrics and unresolved identity rows are excluded. Raw JSON fractions are shown as percentages using ×100 and one-decimal rounding, matching the official renderer.

ExploitGym →

Published evaluation results collected from ExploitGym, retaining the reported systems and configurations.

Intended-target success and flag capture are distinct counts. Task versions and timeout cutoffs remain separate. Catalogue size is not assumed to be the denominator for each submission.

SEC-bench Pro →

Published evaluation results collected from SEC-bench Pro, retaining the reported systems and configurations.

Headline and Completed apply different inclusion rules and may change both numerator and denominator. Provider and backend labels do not identify the actual evaluator.

Evaluating Kimi K3 for Misalignment Risks →

Source-specific extraction of Neo Research · Kimi K3. Findings and measurements retain their original attribution.

Source transcription is not experimental replication. Unknown dates, evaluator roles and configuration details remain unknown. Source groups are not verified rankings.

Evaluating DeepSeek v4 Pro for Frontier Risks →

Source-specific extraction of Neo Research · DeepSeek V4 Pro. Findings and measurements retain their original attribution.

Source transcription is not experimental replication. Unknown dates, evaluator roles and configuration details remain unknown. Source groups are not verified rankings.

GLM-5.2 Risk Evaluation Report, Version 1.1 →

Source-specific extraction of SaferAI · GLM-5.2. Findings and measurements retain their original attribution.

Source transcription is not experimental replication. Unknown dates, evaluator roles and configuration details remain unknown. Source groups are not verified rankings.

CAISI Evaluation of DeepSeek V4 Pro →

Source-specific extraction of CAISI · DeepSeek V4 Pro. Findings and measurements retain their original attribution.

Source transcription is not experimental replication. Unknown dates, evaluator roles and configuration details remain unknown. Source groups are not verified rankings.

Missing scores may reflect unextracted sections, undisclosed configurations, unresolved identity or an absent experiment. These are separate research questions; none implies a zero result.

Interpretation and open questions

Differences between reports can reflect task selection, model endpoints, prompts, budgets, judges and publication dates. Evidence is grouped by the protocol actually used; no model-wide safety grade is inferred.

References

  1. [1] Claude Opus 4.6 — Anthropic ; Publication date and availability section; Official launch article; parameter counts not disclosed
  2. [2] METR Time Horizon 1.1 — source data ; results.claude_opus_4_6_inspect
  3. [3] Evaluating Kimi K3 for Misalignment Risks. 2026-09-11. September 2026 ; §2.3 Figure 17 p.27; §3.1 Figure 20 p.32; §3.1 p.32
  4. [4] Evaluating DeepSeek v4 Pro for Frontier Risks. 2026-05-29. v1.1 · 29 May 2026 ; PDF p. 9; WMDP-Cyber; accuracy; PDF p. 27; DeceptionBench; deception score: single-turn; PDF p. 27; DeceptionBench; deception score: multi-turn w pressure
  5. [5] Early Results on Evaluating GLM 5.2 for Behavioral and Persuasion Risks. 2026-07-03. 3 July 2026 ; #behavioral; Figure 2 / deceptionbench.png; printed label Claude Opus 4.6 / single-turn; #behavioral; Figure 2 / deceptionbench.png; printed label Claude Opus 4.6 / multi-turn with pressure
  6. [6] GLM-5.2 Risk Evaluation Report. 2026-08-02. v1.1 · revised 26 August 2026 ; p.8 Fig.3 printed bar label
  7. [7] CAISI Evaluation of DeepSeek V4 Pro. 2026-05-01. 1 May 2026 ; Capability Results; Figure 2; *** footnote; Capability Results; Figure 2; Figure 2 HTML table, CTF-Archive-Diamond, Anthropic Opus 4.6 (max)
  8. [8] Claude Opus 4.6 System Card. 2026-02-06. 2026-03-06
  9. [9] Claude Opus 4.6 Sabotage Risk Report. 2026-02-10
  10. [10] CyberGym official leaderboard and machine-data extraction ; /level1/25/score_10; /level1/47/score_10; /level1/60/score_10
  11. [11] ExploitGym official leaderboard and benchmark page ; /results/5/on_target
  12. [12] SEC-bench Pro official leaderboard: selected 260617 and historical 260505 ; /0/results/2/score_modes/headline/score; /0/results/2/score_modes/completed/score; /1/results/2/score_modes/headline/score
  13. [13] Jack Payne, Jeremy Miller, et al.. Offensive Cybersecurity Time Horizons. 2026-04-02
  14. [14] Jack Payne, Sean Peters. GPT-5.5 Saturates Our Offensive Cybersecurity Time Horizons. 2026-05-27