WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Library

Risk Evaluation · Technical report

Assessing GPT-6 Astra: FrontierCyber Measures a Sharp Increase in Cyber Capability

NUWA research note · independent review pending

First published: Source checked: 2026-10-25
NUWA Research NoteResearch questionDesign and assumptionsSource findingsNUWA interpretationLimits and contrary evidenceResearch and decision relevanceInstitutions and rolesOriginal resources

Model-assisted reading · Selected sections of the original full text or official article; a complete section-by-section audit remains pending.

At a glance

NUWA interpretation: improvement spans several task scales, while the hardest category remains unresolved.

Research question

Where does GPT-6 Astra improve over GPT-5.6 Sol on realistic security work?

Design and assumptions

The assessment uses FrontierCyber, CyScenarioBench and Atomic Challenges on a shared benchmark snapshot.

Source findings

FrontierCyber solved counts increased from 34/226 to 86/226.

CyScenarioBench average success increased from 27% to 59%; neither model solved an Elite FrontierCyber challenge.

NUWA interpretation

NUWA interpretation: improvement spans several task scales, while the hardest category remains unresolved.

Limits and contrary evidence

Some case configurations reduce protections; at-least-once challenge coverage differs from mean success and does not show hardened-target compromise.

Research and decision relevance

Model recommendation: retain snapshot, protection assumptions and average-versus-at-least-once scoring distinctions.

Precise source locations

Source checking, extraction, editorial approval and replication are recorded separately. Methodology →

Institutions and roles

Cite and reuse

Cite the original publication for its findings. Cite this NUWA record separately for its explanation and retained snapshot.

Original publication · BibTeX
@misc{irregular-astra-cyber-assessment,
  title = {Assessing GPT-6 Astra: FrontierCyber Measures a Sharp Increase in Cyber Capability},
  url = {https://www.irregular.com/research/assessing-gpt-6-astra},
  year = {2026},
  date = {2026-09-03},
  version = {Source capture 2026-10-25},
  note = {Source capture 2026-10-25}
}
NUWA record · BibTeX
@misc{irregular-astra-cyber-assessment-nuwa,
  title = {Assessing GPT-6 Astra: FrontierCyber Measures a Sharp Increase in Cyber Capability — NUWA research record},
  url = {https://whitzard.tech/en/nuwa/whitzard-index/work/irregular-astra-cyber-assessment/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--irregular-astra-cyber-assessment.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--irregular-astra-cyber-assessment.json.}
}

Evidence snapshot 2026-10-29.1 · Index updates · RSS

References

  1. [1] Assessing GPT-6 Astra: FrontierCyber Measures a Sharp Increase in Cyber Capability. 2026-09-03 ; Official publication masthead and article byline; Testing Configuration; Key Outcomes