WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Library

Risk Governance · Method

Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5)

NUWA research note · independent review pending

First published: Source checked: 2026-10-25
Original source ↗Cite this record ↓Cybersecurity →
NUWA Research NoteResearch questionDesign and assumptionsSource findingsNUWA interpretationLimits and contrary evidenceResearch connectionsResearch and decision relevanceInstitutions and rolesOriginal resources

Model-assisted reading · Selected sections of the original full text or official article; a complete section-by-section audit remains pending.

At a glance

SOLVE+ describes scenario difficulty from a human perspective, rather than reporting model success rates.

Research question

How can a multi-step cyber scenario’s distinct capability demands be characterized without collapsing their meaning?

Design and assumptions

The draft extends SOLVE with additional capability dimensions, scores individual steps, and treats orchestration across the whole scenario separately from step aggregation.

Source findings

The specification says capability dimensions should be assessed individually.

Human difficulty may differ substantially from AI difficulty; orchestration is a separate scenario-level contribution.

NUWA interpretation

NUWA interpretation: this is a proposed annotation framework for task demand, not validation of a universal difficulty scale or an AI risk score.

Limits and contrary evidence

Version 0.5 is an early draft. The reviewed interpretation sections do not establish inter-rater reliability, predictive calibration or a measured causal link to harms.

Research connections

NUWA connection: AgentCyberRange concerns linked cyber progression; SOLVE+ could describe its task demands only after explicit mapping and separate review.

Research and decision relevance

NUWA recommendation: retain dimension-level annotations and framework version; do not compare composite difficulty directly with benchmark pass rates.

Precise source locations
  • Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5) · SOLVE+ Scoring Framework version 0.5, Introduction, pp.1–2Selected original resource https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf; sha256:c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a; archived source capture; exact capture time not independently established
  • Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5) · Interpreting scores, pp.2–3Selected original resource https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf; sha256:c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a; archived source capture; exact capture time not independently established
  • Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5) · Summing up scores, pp.3–4Selected original resource https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf; sha256:c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a; archived source capture; exact capture time not independently established

Source checking, extraction, editorial approval and replication are recorded separately. Methodology →

Institutions and roles

Published by Irregular

Cite and reuse

Cite the original publication for its findings. Cite this NUWA record separately for its explanation and retained snapshot.

BibTeX ↓RIS ↓Record + source metadata · JSON ↓Reading coverage · JSONSuggest a correction
Original publication · BibTeX
@misc{solve-plus,
  title = {Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5)},
  url = {https://www.irregular.com/research/solve-plus},
  year = {2026},
  date = {2026-09-03},
  version = {Source capture 2026-10-25},
  note = {Source capture 2026-10-25}
}
NUWA record · BibTeX
@misc{solve-plus-nuwa,
  title = {Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5) — NUWA research record},
  url = {https://whitzard.tech/en/nuwa/whitzard-index/work/solve-plus/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--solve-plus.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--solve-plus.json.}
}

Evidence snapshot 2026-10-29.1 · Index updates · RSS

References

  1. [1] Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5). 2026-09-03 ; Official publication masthead and article byline; SOLVE+ Scoring Framework version 0.5, Introduction, pp.1–2; Interpreting scores, pp.2–3