{"schemaVersion":"nuwa-current-record-1","version":"2026-10-29.1","publication":"published","work":{"id":"irregular-opus-cyber-assessment","title":"Assessing Claude Opus 5.5 Against Offensive Security Benchmarks","aliases":[],"authors":[],"primaryFunction":"evaluation","secondaryFunctions":[],"kind":"technical-report","sourceId":"irregular-opus-cyber-assessment-publication","attributionSourceId":"irregular-opus-cyber-assessment-publication","originalUrl":"https://www.irregular.com/research/assessing-claude-opus-5.5-against-offensive-security-benchmarks","publicationDate":"2026-09-22","updatedOn":"2026-10-25","areas":["cybersecurity"],"scopeNote":{"en":"Relevance is assigned to the research question and stated conditions of the work. A topic tag is not a risk rating.","zh":"风险关联依据研究问题及明确条件建立，主题标签不代表风险评级。"},"protocolIds":[],"contributions":[{"organizationId":"irregular","role":"publisher","sourceId":"irregular-opus-cyber-assessment-publication","locator":"Official publication masthead and article byline"}],"summary":{"en":"Reports model-specific results on multi-stage offensive-security tasks and distinguishes the evaluated challenge subset.","zh":"报告特定模型在多阶段网络安全任务中的结果，并明确受测挑战子集。"},"note":{"question":null,"method":null,"finding":null,"supports":null,"limits":null,"connections":null},"resources":[],"noteStatus":{"question":"limited","method":"limited","finding":"limited","supports":"limited","limits":"limited","connections":"limited"},"noteAvailability":{"en":"A substantive NUWA research note is not yet available. The repeated draft sections were removed pending review of the original methods, findings and limitations; use the original publication for the research account.","zh":"实质性的 NUWA 研究笔记尚未完成。重复草稿章节已移除，待核查原始方法、发现与限制；研究内容请以原始出版物为准。"},"noteSourceLocator":"No complete section-level method/results/limitations review completed for this note; cached original page and any chart audit retained as discovery evidence.","tags":[]},"reading":{"id":"irregular-opus-cyber-assessment","title":"Assessing Claude Opus 5.5 Against Offensive Security Benchmarks","en":{"question":"How well does Opus 5.5 complete multi-stage scenarios under capability elicitation?","design":"A private ten-challenge CyScenarioBench subset uses incident-informed attack trees and realistic network environments with cyber mitigations disabled.","findings":["The article reports 67.6% average solve rate for Opus 5.5, 61.7% for Mythos 5.1 and 53.0% for Opus 5.","Earlier models were re-evaluated after harness revisions."],"interpretation":"NUWA interpretation: these are capability-elicited scenario results, not the deployed model’s misuse rate.","limits":"The short article does not disclose complete per-challenge trial counts or uncertainty; private tasks limit external inspection.","decisionRelevance":"Model recommendation: use the re-evaluated comparison cohort and request trial-level configuration before stronger ranking claims.","takeaway":"NUWA interpretation: these are capability-elicited scenario results, not the deployed model’s misuse rate.","connections":[],"scoring":"Average solve rate over a private ten-challenge subset.","conditions":"Cyber mitigations disabled; earlier models rerun after harness revisions.","statistics":"The article reports 67.6% average solve rate for Opus 5.5, 61.7% for Mythos 5.1 and 53.0% for Opus 5.","usage":"Model recommendation: use the re-evaluated comparison cohort and request trial-level configuration before stronger ranking claims."},"zh":{"question":"充分激发能力时，Opus 5.5能完成多少多阶段场景？","design":"私有十题CyScenarioBench子集采用事件归纳攻击树和真实式网络，关闭网络防护。","findings":["文章报告Opus 5.5平均67.6%，Mythos 5.1为61.7%，Opus 5为53.0%。","框架修订后重新评价早期模型。"],"interpretation":"NUWA 解读：这是激发后的场景能力，不是部署模型滥用率。","limits":"短文未披露完整逐题试次及不确定性，私有任务限制外部审查。","decisionRelevance":"模型建议：使用重新评价的比较组，进一步排名前索取运行配置。","takeaway":"NUWA 解读：这是激发后的场景能力，不是部署模型滥用率。","connections":[],"scoring":"私有十题子集平均解决率。","conditions":"关闭网络防护，修改框架后重跑早期模型。","statistics":"文章报告Opus 5.5平均67.6%，Mythos 5.1为61.7%，Opus 5为53.0%。","usage":"模型建议：使用重新评价的比较组，进一步排名前索取运行配置。"},"assertionPolicy":{"question":"source-research-question","design":"source-finding","findings":"source-finding","interpretation":"nuwa-interpretation","limits":"source-limit-or-explicit-editorial-scope-limit","connections":"source-supported-relationship-only","decisionRelevance":"model-recommendation-not-source-conclusion"},"sourceRefs":[{"sourceId":"irregular-opus-cyber-assessment-publication","url":"https://www.irregular.com/research/assessing-claude-opus-5.5-against-offensive-security-benchmarks","locator":"Testing Configuration","version":"Selected original resource https://www.irregular.com/research/assessing-claude-opus-5.5-against-offensive-security-benchmarks; sha256:6b2f04022559867c111cdd88f572dc049135266f3d7ce36df5cfb366ab03d144; archived source capture; exact capture time not independently established","artifactSha256":"6b2f04022559867c111cdd88f572dc049135266f3d7ce36df5cfb366ab03d144"},{"sourceId":"irregular-opus-cyber-assessment-publication","url":"https://www.irregular.com/research/assessing-claude-opus-5.5-against-offensive-security-benchmarks","locator":"Overall Assessment","version":"Selected original resource https://www.irregular.com/research/assessing-claude-opus-5.5-against-offensive-security-benchmarks; sha256:6b2f04022559867c111cdd88f572dc049135266f3d7ce36df5cfb366ab03d144; archived source capture; exact capture time not independently established","artifactSha256":"6b2f04022559867c111cdd88f572dc049135266f3d7ce36df5cfb366ab03d144"}],"publication":{"state":"published","publishedOn":"2026-10-29","authorizationReference":"user-authorized-global-index-publication-2026-10-29","reviewedCandidateId":"local-6efe31bc4a0c0f37"},"review":{"state":"published-note","sourceScope":"full-text","availableScope":null,"readingCoverage":"selected-source-sections; not a complete section-by-section paper audit","completePaperAudit":false,"independentEvidenceReview":"pending-human-review","bilingualEditorialReview":"pending-human-review","authorship":"model-assisted-research-note","preparedFingerprint":"f655f37204eef92993093a74151f864b193f07f33b719532adfb6d49b49e4100"}},"sources":[{"id":"irregular-opus-cyber-assessment-publication","title":"Assessing Claude Opus 5.5 Against Offensive Security Benchmarks","url":"https://www.irregular.com/research/assessing-claude-opus-5.5-against-offensive-security-benchmarks","version":"Source capture 2026-10-25","publicationDate":"2026-09-22","datePrecision":"day","type":"research-publication","verifiedOn":"2026-10-25","documentId":"https://www.irregular.com/research/assessing-claude-opus-5.5-against-offensive-security-benchmarks"}]}