{"schemaVersion":"nuwa-current-record-1","version":"2026-10-29.1","publication":"published","work":{"id":"solve-plus","title":"Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5)","aliases":[],"authors":[],"primaryFunction":"governance","secondaryFunctions":[],"kind":"method","sourceId":"solve-plus-publication","attributionSourceId":"solve-plus-publication","originalUrl":"https://www.irregular.com/research/solve-plus","publicationDate":"2026-09-03","updatedOn":"2026-10-25","areas":["cybersecurity"],"scopeNote":{"en":"Relevance is assigned to the research question and stated conditions of the work. A topic tag is not a risk rating.","zh":"风险关联依据研究问题及明确条件建立，主题标签不代表风险评级。"},"protocolIds":[],"contributions":[{"organizationId":"irregular","role":"publisher","sourceId":"solve-plus-publication","locator":"Official publication masthead and article byline"}],"summary":{"en":"Defines a scenario-scoring method that decomposes offensive cyber operations into capability requirements and difficult steps.","zh":"提出场景评分方法，将网络攻击过程拆解为能力要求与困难步骤。"},"note":{"question":null,"method":null,"finding":null,"supports":null,"limits":null,"connections":null},"resources":[],"noteStatus":{"question":"limited","method":"limited","finding":"limited","supports":"limited","limits":"limited","connections":"limited"},"noteAvailability":{"en":"A substantive NUWA research note is not yet available. The repeated draft sections were removed pending review of the original methods, findings and limitations; use the original publication for the research account.","zh":"实质性的 NUWA 研究笔记尚未完成。重复草稿章节已移除，待核查原始方法、发现与限制；研究内容请以原始出版物为准。"},"noteSourceLocator":"No complete section-level method/results/limitations review completed for this note; cached original page and any chart audit retained as discovery evidence.","tags":[]},"reading":{"id":"solve-plus","title":"Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5)","en":{"takeaway":"SOLVE+ describes scenario difficulty from a human perspective, rather than reporting model success rates.","question":"How can a multi-step cyber scenario’s distinct capability demands be characterized without collapsing their meaning?","design":"The draft extends SOLVE with additional capability dimensions, scores individual steps, and treats orchestration across the whole scenario separately from step aggregation.","findings":["The specification says capability dimensions should be assessed individually.","Human difficulty may differ substantially from AI difficulty; orchestration is a separate scenario-level contribution."],"interpretation":"NUWA interpretation: this is a proposed annotation framework for task demand, not validation of a universal difficulty scale or an AI risk score.","limits":"Version 0.5 is an early draft. The reviewed interpretation sections do not establish inter-rater reliability, predictive calibration or a measured causal link to harms.","connections":["NUWA connection: AgentCyberRange concerns linked cyber progression; SOLVE+ could describe its task demands only after explicit mapping and separate review."],"decisionRelevance":"NUWA recommendation: retain dimension-level annotations and framework version; do not compare composite difficulty directly with benchmark pass rates."},"zh":{"takeaway":"SOLVE+ 描述人类视角的场景难度，不报告模型成功率。","question":"怎样刻画多步网络场景中不同能力需求，同时不抹去各维度含义？","design":"草案扩展 SOLVE 的能力维度，逐步评分，并将全场景编排与步骤聚合分开处理。","findings":["规范要求分别评估能力维度。","人类难度可能明显不同于 AI 难度；编排是独立的场景级贡献。"],"interpretation":"NUWA 解读：这是任务需求标注框架提案，尚不是通用难度标尺验证或 AI 风险分数。","limits":"0.5 属早期草案；已读解释章节未确立评分者一致性、预测校准或与危害的因果联系。","connections":["NUWA 关联：AgentCyberRange 关注联动推进；只有明确映射并另行审阅后，才能用 SOLVE+ 描述其任务需求。"],"decisionRelevance":"NUWA 建议：保留逐维标注与框架版本，不把聚合难度与基准通过率直接比较。"},"sourceRefs":[{"sourceId":"solve-plus-publication","url":"https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf","locator":"SOLVE+ Scoring Framework version 0.5, Introduction, pp.1–2","version":"Selected original resource https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf; sha256:c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a; archived source capture; exact capture time not independently established","artifactSha256":"c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a"},{"sourceId":"solve-plus-publication","url":"https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf","locator":"Interpreting scores, pp.2–3","version":"Selected original resource https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf; sha256:c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a; archived source capture; exact capture time not independently established","artifactSha256":"c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a"},{"sourceId":"solve-plus-publication","url":"https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf","locator":"Summing up scores, pp.3–4","version":"Selected original resource https://irregular-public-docs.s3.eu-north-1.amazonaws.com/full_solve_plus_framework.pdf; sha256:c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a; archived source capture; exact capture time not independently established","artifactSha256":"c8127041c04cf20c966f19d85deba9663f75739b3463c57a54b5425c0365803a"}],"publication":{"state":"published","publishedOn":"2026-10-29","authorizationReference":"user-authorized-global-index-publication-2026-10-29","reviewedCandidateId":"local-6efe31bc4a0c0f37"},"review":{"state":"published-note","sourceScope":"full-text","availableScope":null,"readingCoverage":"selected substantive sections of the full source body","completePaperAudit":false,"independentEvidenceReview":"pending-human-review","bilingualEditorialReview":"pending-human-review","authorship":"model-assisted-research-note","preparedFingerprint":"6d164fad544b4cf0ac37c6aa3f95ea4b9631ec58fea029e7815b117245a38c22"}},"sources":[{"id":"solve-plus-publication","title":"Introducing SOLVE+: Scoring Cyber Scenarios (Version 0.5)","url":"https://www.irregular.com/research/solve-plus","version":"Source capture 2026-10-25","publicationDate":"2026-09-03","datePrecision":"day","type":"research-publication","verifiedOn":"2026-10-25","documentId":"https://www.irregular.com/research/solve-plus"}]}