NUWA 风险评测 · 技术报告
Toward Comprehensive Benchmarking of the Biological Knowledge of Frontier Large Language Models
NUWA 研究解读 · 独立复核待完成
NUWA Research Note
研究问题研究设计与假设来源发现NUWA 解读局限与相反证据研究与决策意义机构与角色原始资源模型辅助整理 · 选读原始全文或官方文章中的相关章节；尚未完成逐章节审计。
研究速读
NUWA 解读：知识得分、拒绝稳健性与现实增益需要不同证据。
研究问题
既有生物化学知识与拒绝基准能说明前沿模型什么？
研究设计与假设
官网报告概述比较截至2025年5月的模型，覆盖八项知识或拒绝基准，并讨论人类基线。
来源发现
作者指出多个基准趋于饱和，前沿推理模型超部分专家题基线。
所测降低拒绝训练也降低部分知识表现，风险影响仍不明确。
NUWA 解读
NUWA 解读：知识得分、拒绝稳健性与现实增益需要不同证据。
局限与相反证据
此次阅读为官网概述、要点及建议，未完整审查报告方法。
研究与决策意义
模型建议：重视匹配专长的人类基线、更难保留题及实现披露。
精确来源位置
- Toward Comprehensive Benchmarking of the Biological Knowledge of Frontier Large Language Models · Report overviewSelected original resource https://www.rand.org/pubs/research_reports/RRA3797-1.html; sha256:3a110b6e4b9c0f8c321b3c01015fa4ddc3052614e0585722c3c73cbc964f459b; archived source capture; exact capture time not independently established
- Toward Comprehensive Benchmarking of the Biological Knowledge of Frontier Large Language Models · Key TakeawaysSelected original resource https://www.rand.org/pubs/research_reports/RRA3797-1.html; sha256:3a110b6e4b9c0f8c321b3c01015fa4ddc3052614e0585722c3c73cbc964f459b; archived source capture; exact capture time not independently established
- Toward Comprehensive Benchmarking of the Biological Knowledge of Frontier Large Language Models · RecommendationsSelected original resource https://www.rand.org/pubs/research_reports/RRA3797-1.html; sha256:3a110b6e4b9c0f8c321b3c01015fa4ddc3052614e0585722c3c73cbc964f459b; archived source capture; exact capture time not independently established
来源核查、数据提取、编辑批准与实验复现分别记录。 方法说明 →
机构与角色
作者 (23)
Sunishchal Dev · Charles Teague · Grant Ellison · Kyle Brady · Jeffrey Lee · Sarah L. Gebauer · Henry Alexander Bradley · Dawid Maciorowski · Bria Persaud · Jordan Despanie · Barbara Del Castello · Alyssa Worland · Michael Miller · Adrian Salas · Dave Nguyen · James Liu · Jason Johnson · Andrew Sloan · Will Stonehouse · Travis Merrill · Thomas Goode · McKelvey, Greg, Jr. · Ella Guest
引用与复用
引用研究发现时请引用原始出版物；引用 NUWA 的整理与解释时，单独引用本站记录及对应快照。
原始出版物 · BibTeX
@misc{rand-biological-benchmarking,
title = {Toward Comprehensive Benchmarking of the Biological Knowledge of Frontier Large Language Models},
url = {https://www.rand.org/pubs/research_reports/RRA3797-1.html},
author = {Sunishchal Dev and Charles Teague and Grant Ellison and Kyle Brady and Jeffrey Lee and Sarah L. Gebauer and Henry Alexander Bradley and Dawid Maciorowski and Bria Persaud and Jordan Despanie and Barbara Del Castello and Alyssa Worland and Michael Miller and Adrian Salas and Dave Nguyen and James Liu and Jason Johnson and Andrew Sloan and Will Stonehouse and Travis Merrill and Thomas Goode and McKelvey, Greg, Jr. and Ella Guest},
year = {2025},
date = {2025-11-25},
version = {Source capture 2026-10-25},
note = {Source capture 2026-10-25}
}
NUWA 记录 · BibTeX
@misc{rand-biological-benchmarking-nuwa,
title = {Toward Comprehensive Benchmarking of the Biological Knowledge of Frontier Large Language Models — NUWA research record},
url = {https://whitzard.tech/nuwa/whitzard-index/work/rand-biological-benchmarking/},
version = {2026-10-29.1},
organization = {NUWA Frontier AI Safety Lab},
howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--rand-biological-benchmarking.json},
note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--rand-biological-benchmarking.json.}
}
证据快照 2026-10-29.1 · 索引更新 · RSS
参考文献
- [1] Dev, Sunishchal, Teague, Charles 等. Toward Comprehensive Benchmarking of the Biological Knowledge of Frontier Large Language Models. 2025-11-25 ; Official publication masthead and article byline; Report overview; Key Takeaways