Anthropic
Claude Opus 4.1
Published evidence on capabilities, behavioral tendencies and observed actions.
- First public availability
- 2025-08-05
- Parameters
- Not disclosed
- Metadata updated
- 2026-10-27
Evidence overview
Published risk evidence is organized by assessment and protocol. Missing evidence is not a low-risk finding.
NUWA curates and interprets these sources. Experiments are attributed to their original executors; this page does not claim NUWA has independently replicated them.
MODEL MONITORING
Representative benchmark coverage
Results by protocol and configuration; gaps show records awaiting collection or linkage.
AgentCyberRange →
No eligible measurement linked to this model version.
Cybench →
No eligible measurement linked to this model version.
CyberGym →
2 measurements
METR Time Horizons →
2 measurements
- 100.47 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react
- 23.46 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react
SEC-bench Pro →
No eligible measurement linked to this model version.
MASK →
No eligible measurement linked to this model version.
Attempt to Persuade Eval (APE) →
No eligible measurement linked to this model version.
DeceptionBench →
No eligible measurement linked to this model version.
PersuSafety →
No eligible measurement linked to this model version.
All linked measurements
Each result retains its protocol and unit.
4 observations
| System / model | Result | Condition status | Task / conditions | Evaluator / report | Dates |
|---|---|---|---|---|---|
| 25%CyberGym · Success rate | Incomplete | level1score_10Anthropic Agent | Not disclosedCyberGym official leaderboard and machine-data extraction | Release 2025-08-05Report — | |
| 61.3%CyberGym · Success rate | Incomplete | level1score_10Anthropic Agent | Not disclosedCyberGym official leaderboard and machine-data extraction | Release 2025-08-05Report — | |
| 100.47 minMETR Time Horizons · 50% task-completion horizonSource 95% CI [59.272391, 159.451918] min | Incomplete | METR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react | METRMETR Time Horizon 1.1 — source data | Release 2025-08-05Report — | |
| 23.46 minMETR Time Horizons · 80% task-completion horizonSource 95% CI [10.538456, 47.785951] min | Incomplete | METR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react | METRMETR Time Horizon 1.1 — source data | Release 2025-08-05Report — |
Developer disclosures
No developer-authored safety report has been linked to this exact model record in the current collection.
External assessments
METR
METR Time Horizon 1.1 →
Estimated task difficulty at 50% and 80% success, measured in human-expert minutes.
Publication date not establishedCyberGym official snapshot →
Published evaluation results collected from CyberGym, retaining the reported systems and configurations.
Publication date not establishedEvidence by risk topic
Autonomy 1 protocol results
METR Time Horizon 1.1 →
External evaluation · Executed by METR
- 50% task-completion horizon
- 100.47 min
- 80% task-completion horizon
- 23.46 min
Task counts/weights vary with source tasks and scaffold coverage; see methodology.
Deception No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Cybersecurity 2 protocol results
CyberGym · level1 · score_10 →
External evaluation · Executed by
- Success rate
- 61.3%
Per-result sample size not disclosed
CyberGym · level1 · score_10 →
External evaluation · Executed by
- Success rate
- 25%
Per-result sample size not disclosed
CBRN No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Disinformation No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Autonomous physical harm No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Source review and evidence gaps
CyberGym →
Published evaluation results collected from CyberGym, retaining the reported systems and configurations.
The site reports submitted systems under different configurations. Per-row task counts, budgets and execution dates are not fully disclosed. Undefined metrics and unresolved identity rows are excluded. Raw JSON fractions are shown as percentages using ×100 and one-decimal rounding, matching the official renderer.
Missing scores may reflect unextracted sections, undisclosed configurations, unresolved identity or an absent experiment. These are separate research questions; none implies a zero result.
Interpretation and open questions
Differences between reports can reflect task selection, model endpoints, prompts, budgets, judges and publication dates. Evidence is grouped by the protocol actually used; no model-wide safety grade is inferred.
References
- [1] Claude Opus 4.1 — Anthropic ; Publication date and availability section; Official launch article; parameter counts not disclosed
- [2] METR Time Horizon 1.1 — source data ; results.claude_4_1_opus_inspect
- [3] CyberGym official leaderboard and machine-data extraction ; /level1/64/score_10; /level1/68/score_10