WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Models

Anthropic

Claude Opus 4.1

Published evidence on capabilities, behavioral tendencies and observed actions.

First public availability
2025-08-05
Parameters
Not disclosed
Metadata updated
2026-10-27
Sources ↓

Evidence overview

Published risk evidence is organized by assessment and protocol. Missing evidence is not a low-risk finding.

NUWA curates and interprets these sources. Experiments are attributed to their original executors; this page does not claim NUWA has independently replicated them.

MODEL MONITORING

Representative benchmark coverage

Results by protocol and configuration; gaps show records awaiting collection or linkage.

Cybench →

No eligible measurement linked to this model version.

METR Time Horizons →

2 measurements

  • 100.47 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react
  • 23.46 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react

MASK →

No eligible measurement linked to this model version.

All linked measurements

Each result retains its protocol and unit.

4 observations

Measurements and source conditions
System / modelResultCondition statusTask / conditionsEvaluator / reportDates
Claude Opus 4.1 · Anthropic AgentClaude Opus 4.125%CyberGym · Success rateIncompletelevel1score_10Anthropic AgentNot disclosedCyberGym official leaderboard and machine-data extractionRelease 2025-08-05Report —
Claude Opus 4.1 · Anthropic AgentClaude Opus 4.161.3%CyberGym · Success rateIncompletelevel1score_10Anthropic AgentNot disclosedCyberGym official leaderboard and machine-data extractionRelease 2025-08-05Report —
Claude Opus 4.1 · METR scaffoldClaude Opus 4.1100.47 minMETR Time Horizons · 50% task-completion horizonSource 95% CI [59.272391, 159.451918] minIncompleteMETR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/reactMETRMETR Time Horizon 1.1 — source dataRelease 2025-08-05Report —
Claude Opus 4.1 · METR scaffoldClaude Opus 4.123.46 minMETR Time Horizons · 80% task-completion horizonSource 95% CI [10.538456, 47.785951] minIncompleteMETR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/reactMETRMETR Time Horizon 1.1 — source dataRelease 2025-08-05Report —

Developer disclosures

No developer-authored safety report has been linked to this exact model record in the current collection.

External assessments

METR

METR Time Horizon 1.1 →

Estimated task difficulty at 50% and 80% success, measured in human-expert minutes.

Publication date not established

CyberGym official snapshot →

Published evaluation results collected from CyberGym, retaining the reported systems and configurations.

Publication date not established

Evidence by risk topic

Autonomy 1 protocol results

METR Time Horizon 1.1 →

External evaluation · Executed by METR

50% task-completion horizon
100.47 min
80% task-completion horizon
23.46 min

Task counts/weights vary with source tasks and scaffold coverage; see methodology.

Deception No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Cybersecurity 2 protocol results
CBRN No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Disinformation No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Autonomous physical harm No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Source review and evidence gaps

CyberGym →

Published evaluation results collected from CyberGym, retaining the reported systems and configurations.

The site reports submitted systems under different configurations. Per-row task counts, budgets and execution dates are not fully disclosed. Undefined metrics and unresolved identity rows are excluded. Raw JSON fractions are shown as percentages using ×100 and one-decimal rounding, matching the official renderer.

Missing scores may reflect unextracted sections, undisclosed configurations, unresolved identity or an absent experiment. These are separate research questions; none implies a zero result.

Interpretation and open questions

Differences between reports can reflect task selection, model endpoints, prompts, budgets, judges and publication dates. Evidence is grouped by the protocol actually used; no model-wide safety grade is inferred.

References

  1. [1] Claude Opus 4.1 — Anthropic ; Publication date and availability section; Official launch article; parameter counts not disclosed
  2. [2] METR Time Horizon 1.1 — source data ; results.claude_4_1_opus_inspect
  3. [3] CyberGym official leaderboard and machine-data extraction ; /level1/64/score_10; /level1/68/score_10