风险评测 · 研究
Evaluating Frontier Models for Dangerous Capabilities
NUWA 研究解读 · 独立复核待完成
NUWA Research Note
研究问题研究设计与假设来源发现NUWA 解读局限与相反证据研究与决策意义机构与角色原始资源模型辅助整理 · 选读原始全文或官方文章中的相关章节;尚未完成逐章节审计。
研究速读
NUWA 解读:有边界的阴性结果依赖任务覆盖与能力激发。
研究问题
系统性危险能力评测计划能发现哪些预警信号?
研究设计与假设
Gemini 1.0试点评测说服欺骗、网络、自我扩散与自我推理,采用多任务和激发方式。
来源发现
作者在受测模型未发现强危险能力,但指出早期信号。
漏洞补丁分类正确率在不同数据集明显不同(§5.2)。
NUWA 解读
NUWA 解读:有边界的阴性结果依赖任务覆盖与能力激发。
局限与相反证据
这是特定代际的早期试点,不是未来危险能力的持续保证。
研究与决策意义
模型建议:把领域任务分解用于审计设计,并为所有能力结论标注时间。
精确来源位置
- Evaluating Frontier Models for Dangerous Capabilities · AbstractSelected original resource https://arxiv.org/html/2403.13793; sha256:12872dcaaa7ad2297665fd85c8404512e050c28e5616ce15c854f536ea0fd945; archived source capture; exact capture time not independently established
- Evaluating Frontier Models for Dangerous Capabilities · §2 Overview of evaluations and agentsSelected original resource https://arxiv.org/html/2403.13793; sha256:12872dcaaa7ad2297665fd85c8404512e050c28e5616ce15c854f536ea0fd945; archived source capture; exact capture time not independently established
- Evaluating Frontier Models for Dangerous Capabilities · §5.2 ResultsSelected original resource https://arxiv.org/html/2403.13793; sha256:12872dcaaa7ad2297665fd85c8404512e050c28e5616ce15c854f536ea0fd945; archived source capture; exact capture time not independently established
- Evaluating Frontier Models for Dangerous Capabilities · §6.4 DiscussionSelected original resource https://arxiv.org/html/2403.13793; sha256:12872dcaaa7ad2297665fd85c8404512e050c28e5616ce15c854f536ea0fd945; archived source capture; exact capture time not independently established
来源核查、数据提取、编辑批准与实验复现分别记录。 方法说明 →
机构与角色
作者 (27)
Mary Phuong · Matthew Aitchison · Elliot Catt · Sarah Cogan · Alexandre Kaskasoli · Victoria Krakovna · David Lindner · Matthew Rahtz · Yannis Assael · Sarah Hodkinson · Heidi Howard · Tom Lieberum · Ramana Kumar · Maria Abi Raad · Albert Webson · Lewis Ho · Sharon Lin · Sebastian Farquhar · Marcus Hutter · Gregoire Deletang · Anian Ruoss · Seliem El-Sayed · Sasha Brown · Anca Dragan · Rohin Shah · Allan Dafoe · Toby Shevlane
引用与复用
引用研究发现时请引用原始出版物;引用 NUWA 的整理与解释时,单独引用本站记录及对应快照。
原始出版物 · BibTeX
@misc{deepmind-dangerous-capabilities,
title = {Evaluating Frontier Models for Dangerous Capabilities},
url = {https://arxiv.org/abs/2403.13793},
author = {Mary Phuong and Matthew Aitchison and Elliot Catt and Sarah Cogan and Alexandre Kaskasoli and Victoria Krakovna and David Lindner and Matthew Rahtz and Yannis Assael and Sarah Hodkinson and Heidi Howard and Tom Lieberum and Ramana Kumar and Maria Abi Raad and Albert Webson and Lewis Ho and Sharon Lin and Sebastian Farquhar and Marcus Hutter and Gregoire Deletang and Anian Ruoss and Seliem El-Sayed and Sasha Brown and Anca Dragan and Rohin Shah and Allan Dafoe and Toby Shevlane},
year = {2024},
date = {2024-03-20},
version = {arXiv:2403.13793v2},
note = {arXiv:2403.13793v2}
}
NUWA 记录 · BibTeX
@misc{deepmind-dangerous-capabilities-nuwa,
title = {Evaluating Frontier Models for Dangerous Capabilities — NUWA research record},
url = {https://whitzard.tech/nuwa/whitzard-index/work/deepmind-dangerous-capabilities/},
version = {2026-10-29.1},
organization = {NUWA Frontier AI Safety Lab},
howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--deepmind-dangerous-capabilities.json},
note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--deepmind-dangerous-capabilities.json.}
}
证据快照 2026-10-29.1 · 索引更新 · RSS
参考文献
- [1] Mary Phuong, Matthew Aitchison 等. Evaluating Frontier Models for Dangerous Capabilities. 2024-03-20. v2 [arXiv]; Abstract; §2 Overview of evaluations and agents; §5.2 Results
- [2] Evaluating Frontier Models for Dangerous Capabilities. 2024-03-21 ; Official research publication and author list