NUWA 风险评测 · 评测基准
ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agents
NUWA 研究解读 · 独立复核待完成
NUWA Research Note
研究问题研究设计与假设来源发现NUWA 解读局限与相反证据研究与决策意义机构与角色原始资源模型辅助整理 · 选读原始全文或官方文章中的相关章节；尚未完成逐章节审计。
研究速读
NUWA 解读：中间能力等级能揭示二元崩溃指标隐藏的信息。
研究问题
从触发已知缺陷到证实安全影响，智能体停在哪一步？
研究设计与假设
41个V8缺陷以16个确定性能力标志、差分检查和每次随机验证判分。
来源发现
公开模型很少跨越所述Tier3到Tier2边界，GPT-5.5仅在一个缺陷跨越。
Mythos Preview更稳定，说明基准可达性与公开模型表现有别（结论）。
NUWA 解读
NUWA 解读：中间能力等级能揭示二元崩溃指标隐藏的信息。
局限与相反证据
单例跨越只证明存在性；V8样本和有限框架不能估计部署攻击率。
研究与决策意义
模型建议：报告能力等级与验证条件，不将所有崩溃称为完整利用。
精确来源位置
- ExploitBench : A Capability Ladder Benchmark for LLM Cybersecurity Agents · AbstractSelected original resource https://arxiv.org/html/2605.14153; sha256:83a1a60bec38561f7d789c0d6161b3934f5df91fbc9c8c6926ef2def526f44c7; archived source capture; exact capture time not independently established
- ExploitBench : A Capability Ladder Benchmark for LLM Cybersecurity Agents · §2 DesignSelected original resource https://arxiv.org/html/2605.14153; sha256:83a1a60bec38561f7d789c0d6161b3934f5df91fbc9c8c6926ef2def526f44c7; archived source capture; exact capture time not independently established
- ExploitBench : A Capability Ladder Benchmark for LLM Cybersecurity Agents · §4 EvaluationSelected original resource https://arxiv.org/html/2605.14153; sha256:83a1a60bec38561f7d789c0d6161b3934f5df91fbc9c8c6926ef2def526f44c7; archived source capture; exact capture time not independently established
- ExploitBench : A Capability Ladder Benchmark for LLM Cybersecurity Agents · §7 ConclusionSelected original resource https://arxiv.org/html/2605.14153; sha256:83a1a60bec38561f7d789c0d6161b3934f5df91fbc9c8c6926ef2def526f44c7; archived source capture; exact capture time not independently established
来源核查、数据提取、编辑批准与实验复现分别记录。 方法说明 →
机构与角色
作者 (2)
Seunghyun Lee · David Brumley
评测协议
引用与复用
引用研究发现时请引用原始出版物；引用 NUWA 的整理与解释时，单独引用本站记录及对应快照。
原始出版物 · BibTeX
@misc{exploitbench,
title = {ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agents},
url = {https://arxiv.org/abs/2605.14153},
author = {Seunghyun Lee and David Brumley},
year = {2026},
date = {2026-05-13},
version = {arXiv:2605.14153v1},
note = {arXiv:2605.14153v1}
}
NUWA 记录 · BibTeX
@misc{exploitbench-nuwa,
title = {ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agents — NUWA research record},
url = {https://whitzard.tech/nuwa/whitzard-index/work/exploitbench/},
version = {2026-10-29.1},
organization = {NUWA Frontier AI Safety Lab},
howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--exploitbench.json},
note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--exploitbench.json.}
}
证据快照 2026-10-29.1 · 索引更新 · RSS
参考文献
- [1] Seunghyun Lee, David Brumley. ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agents. 2026-05-13. v1 [arXiv]; Author affiliations on the original paper title page; Abstract; §2 Design