白泽(Whitzard)女娲实验室 ↗
NUWANUWA INDEX

搜索 NUWA Index

研究 · 测量协议 · 评测结果 · 观点

English
← 研究目录

风险评测 · 评测基准

BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems

NUWA 研究解读 · 独立复核待完成

首次发表: 来源核验: 2026-10-25
NUWA Research Note研究问题研究设计与假设来源发现NUWA 解读局限与相反证据研究与决策意义机构与角色原始资源

模型辅助整理 · 选读原始全文或官方文章中的相关章节;尚未完成逐章节审计。

研究速读

NUWA 解读:提供信息与成功检查定义不同能力测量。

研究问题

同一框架能否区分真实应用中的发现、利用与修补?

研究设计与假设

25个手工配置系统含40项获赏漏洞,通过不同提示信息分别评测发现、利用和修补。

来源发现

最多三次尝试时,不同框架最佳分别为12.5%、67.5%、90%。

这不是同一模型的全生命周期完成率。

NUWA 解读

NUWA 解读:提供信息与成功检查定义不同能力测量。

局限与相反证据

已添加漏洞覆盖和不完整不变量可能漏新问题或未充分修复,环境构造很依赖人工。

研究与决策意义

模型建议:保留各任务智能体、尝试数及验证覆盖,不合成单一网络分。

精确来源位置

来源核查、数据提取、编辑批准与实验复现分别记录。 方法说明 →

机构与角色

作者 (34)

Andy K. Zhang · Joey Ji · Celeste Menders · Riya Dulepet · Thomas Qin · Ron Y. Wang · Junrong Wu · Kyleen Liao · Jiliang Li · Jinghan Hu · Sara Hong · Nardos Demilew · Shivatmica Murgai · Jason Tran · Nishka Kacheria · Ethan Ho · Denis Liu · Lauren McLane · Olivia Bruvik · Dai-Rong Han · Seungwoo Kim · Akhil Vyas · Cuiyuanxiu Chen · Ryan Li · Weiran Xu · Jonathan Z. Ye · Prerit Choudhary · Siddharth M. Bhatia · Vikram Sivashankar · Yuxuan Bao · Dawn Song · Dan Boneh · Daniel E. Ho · Percy Liang

评测协议

BountyBench →

引用与复用

引用研究发现时请引用原始出版物;引用 NUWA 的整理与解释时,单独引用本站记录及对应快照。

原始出版物 · BibTeX
@misc{bountybench,
  title = {BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems},
  url = {https://arxiv.org/abs/2505.15216},
  author = {Andy K. Zhang and Joey Ji and Celeste Menders and Riya Dulepet and Thomas Qin and Ron Y. Wang and Junrong Wu and Kyleen Liao and Jiliang Li and Jinghan Hu and Sara Hong and Nardos Demilew and Shivatmica Murgai and Jason Tran and Nishka Kacheria and Ethan Ho and Denis Liu and Lauren McLane and Olivia Bruvik and Dai-Rong Han and Seungwoo Kim and Akhil Vyas and Cuiyuanxiu Chen and Ryan Li and Weiran Xu and Jonathan Z. Ye and Prerit Choudhary and Siddharth M. Bhatia and Vikram Sivashankar and Yuxuan Bao and Dawn Song and Dan Boneh and Daniel E. Ho and Percy Liang},
  year = {2025},
  date = {2025-05-21},
  version = {arXiv:2505.15216v3},
  note = {arXiv:2505.15216v3}
}
NUWA 记录 · BibTeX
@misc{bountybench-nuwa,
  title = {BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems — NUWA research record},
  url = {https://whitzard.tech/nuwa/whitzard-index/work/bountybench/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--bountybench.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--bountybench.json.}
}

证据快照 2026-10-29.1 · 索引更新 · RSS

参考文献

  1. [1] Andy K. Zhang, Joey Ji 等. BountyBench: Dollar Impact of AI Agent Attackers and Defenders on Real-World Cybersecurity Systems. 2025-05-21. v3 [arXiv]; Author affiliations on the original paper title page; Abstract; §4 Experiments