WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← NUWA Index

Evidence record

GPT-5.5 / Codex 0.133.0

AgentCyberRange · Evidence record

Sources and provenance ↓ Read the research narrative →

Source snapshot, chart and review scope →

Original source charts and materials

Recorded measurements

Success rate (Pass@3)
31.71%

Per-result sample size not disclosed

Codex · Budget not specified

Assessment provenance

AgentCyberRange official snapshot → · External report

Actual evaluation: · Model record →

Method and scope

Task success across web exploitation and post-exploitation settings; configurations must be checked per submission.

Evidence type
Benchmark
Assessment subject
AI agent completing cyber-range tasks
Primary dimension
Capability
Evidence snapshot
2026-10-29.1

Primary dimension follows the source’s measured construct. Metric-level interpretations may differ.

Source finding

Success rate (Pass@3): 31.71 %. Conditions are retained from the source.

Limitations

Changing task sets and submitted agent configurations prevent unrestricted comparison.

Pass@3 is preserved as an author-defined metric, not interpreted as a disclosed number of independent trials. Only explicitly displayed score fields are included; top-level aliases are not independent results. The source model label is not a verified model endpoint. Row sample counts, budgets and execution dates remain unknown. Source-reported website value; no NUWA experimental replication or receipt. No row-specific evaluation date, exact model API/snapshot identifier, trial count, numerator, denominator, or budget is disclosed in these leaderboard records.

Related research questions

References

  1. [1] AgentCyberRange: Evaluate Agent Cyberattack Capabilities in Enterprise-like Cyber Ranges ; routes-B-0Mubrq.js::$R/1/level0/pass3
  2. [2] AgentCyberRange: Evaluating autonomous cyber capabilities over long-horizon tasks ; Research introduction: Fudan–Whitzard team