NUWA 风险治理 · 技术报告
Model evaluation for extreme risks
NUWA 研究解读 · 独立复核待完成
NUWA Research Note
研究问题研究设计与假设来源发现NUWA 解读局限与相反证据研究联系研究与决策意义机构与角色原始资源模型辅助整理 · 选读原始全文或官方文章中的相关章节；尚未完成逐章节审计。
研究速读
论文将评测纳入训练、部署、安保及外部问责决策。
研究问题
测试不能覆盖所有风险时，评测证据应如何约束前沿开发？
研究设计与假设
概念框架区分危险能力与对齐，结合内部评测、外部研究访问及外部审计，再将结果连接治理响应。
来源发现
提议流程既包含训练前评估，也包含开发中的持续评测。
论文明确讨论未知威胁、潜在能力、欺骗行为及评测工作自身的信息风险。
NUWA 解读
NUWA 解读：治理价值取决于证据能改变什么决策，而不只取决于基准技术复杂度。
局限与相反证据
这是治理蓝图，不是验证过的风险估计器；模型外因素与不成熟的评估生态限制保证力度。
研究联系
NUWA 关联：训练过程和嵌入式评估细化深入访问；防护评估原则具体化要求与证据联系。
研究与决策意义
NUWA 建议：每项评测绑定决策负责人、响应规则和残余不确定性，并单独评估传播风险。
精确来源位置
- Model evaluation for extreme risks · 2 Extreme risks from general-purpose modelsSelected original resource https://arxiv.org/html/2305.15324; sha256:03db3f9243f2a9495a741bb7ed9e332f890302a9abd69b22a6181d2288129639; archived source capture; exact capture time not independently established
- Model evaluation for extreme risks · 3 Model evaluation as critical governance infrastructureSelected original resource https://arxiv.org/html/2305.15324; sha256:03db3f9243f2a9495a741bb7ed9e332f890302a9abd69b22a6181d2288129639; archived source capture; exact capture time not independently established
- Model evaluation for extreme risks · 4 Building evaluations for extreme riskSelected original resource https://arxiv.org/html/2305.15324; sha256:03db3f9243f2a9495a741bb7ed9e332f890302a9abd69b22a6181d2288129639; archived source capture; exact capture time not independently established
- Model evaluation for extreme risks · 5 Limitations and hazardsSelected original resource https://arxiv.org/html/2305.15324; sha256:03db3f9243f2a9495a741bb7ed9e332f890302a9abd69b22a6181d2288129639; archived source capture; exact capture time not independently established
来源核查、数据提取、编辑批准与实验复现分别记录。 方法说明 →
机构与角色
作者 (21)
Toby Shevlane · Sebastian Farquhar · Ben Garfinkel · Mary Phuong · Jess Whittlestone · Jade Leung · Daniel Kokotajlo · Nahema Marchal · Markus Anderljung · Noam Kolt · Lewis Ho · Divya Siddarth · Shahar Avin · Will Hawkins · Been Kim · Iason Gabriel · Vijay Bolina · Jack Clark · Yoshua Bengio · Paul Christiano · Allan Dafoe
引用与复用
引用研究发现时请引用原始出版物；引用 NUWA 的整理与解释时，单独引用本站记录及对应快照。
原始出版物 · BibTeX
@misc{extreme-risk-evaluations,
title = {Model evaluation for extreme risks},
url = {https://arxiv.org/abs/2305.15324},
author = {Toby Shevlane and Sebastian Farquhar and Ben Garfinkel and Mary Phuong and Jess Whittlestone and Jade Leung and Daniel Kokotajlo and Nahema Marchal and Markus Anderljung and Noam Kolt and Lewis Ho and Divya Siddarth and Shahar Avin and Will Hawkins and Been Kim and Iason Gabriel and Vijay Bolina and Jack Clark and Yoshua Bengio and Paul Christiano and Allan Dafoe},
year = {2023},
date = {2023-05-24},
version = {arXiv:2305.15324v2},
note = {arXiv:2305.15324v2}
}
NUWA 记录 · BibTeX
@misc{extreme-risk-evaluations-nuwa,
title = {Model evaluation for extreme risks — NUWA research record},
url = {https://whitzard.tech/nuwa/whitzard-index/work/extreme-risk-evaluations/},
version = {2026-10-29.1},
organization = {NUWA Frontier AI Safety Lab},
howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--extreme-risk-evaluations.json},
note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--extreme-risk-evaluations.json.}
}
证据快照 2026-10-29.1 · 索引更新 · RSS
参考文献
- [1] Toby Shevlane, Sebastian Farquhar 等. Model evaluation for extreme risks. 2023-05-24. v2 [arXiv]; Author affiliations on the original paper title page; 2 Extreme risks from general-purpose models; 3 Model evaluation as critical governance infrastructure