风险评测 · 研究方法

Guidelines for capability elicitation

NUWA 研究解读 · 独立复核待完成

首次发表: 2024-03-15来源核验: 2026-10-25

原始来源 ↗引用本记录 ↓

NUWA Research Note

研究问题研究设计与假设来源发现 NUWA 解读局限与相反证据研究与决策意义机构与角色原始资源

模型辅助整理 · 选读原始全文或官方文章中的相关章节；尚未完成逐章节审计。

研究速读

NUWA 解读：低表现只有经合理激发及效度检查后才支持无能力。

研究问题

如何避免把框架或任务访问故障误认作模型无能力？

研究设计与假设

METR指南分基础激发、失败处理、警讯检查、人类基线和报告，并区分伪失败与真实失败。

来源发现

目标是合理后训练增强可访问的能力，而不只默认聊天表现。

同时检查记忆等高估来源。

NUWA 解读

NUWA 解读：低表现只有经合理激发及效度检查后才支持无能力。

局限与相反证据

这是围绕通用自主能力设计的指南，不保证所有能力均已激发。

研究与决策意义

模型建议：在评测报告记录失败分类、激发变更及基线条件。

精确来源位置

Guidelines for capability elicitation · §1 OverviewSelected original resource https://metr.org/blog/2024-03-15-guidelines-for-capability-elicitation/; sha256:6203c5d9af6dafc58c41650e57a00a542ec581d04d6cd584c71c6a8076ca823a; archived source capture; exact capture time not independently established
Guidelines for capability elicitation · §2.1 Basic elicitationSelected original resource https://metr.org/blog/2024-03-15-guidelines-for-capability-elicitation/; sha256:6203c5d9af6dafc58c41650e57a00a542ec581d04d6cd584c71c6a8076ca823a; archived source capture; exact capture time not independently established
Guidelines for capability elicitation · §2.2 Handle remaining failuresSelected original resource https://metr.org/blog/2024-03-15-guidelines-for-capability-elicitation/; sha256:6203c5d9af6dafc58c41650e57a00a542ec581d04d6cd584c71c6a8076ca823a; archived source capture; exact capture time not independently established
Guidelines for capability elicitation · §3 Categorizing failure typesSelected original resource https://metr.org/blog/2024-03-15-guidelines-for-capability-elicitation/; sha256:6203c5d9af6dafc58c41650e57a00a542ec581d04d6cd584c71c6a8076ca823a; archived source capture; exact capture time not independently established
Guidelines for capability elicitation · §5 Recommendations for avoiding overestimation of capabilitiesSelected original resource https://metr.org/blog/2024-03-15-guidelines-for-capability-elicitation/; sha256:6203c5d9af6dafc58c41650e57a00a542ec581d04d6cd584c71c6a8076ca823a; archived source capture; exact capture time not independently established

来源核查、数据提取、编辑批准与实验复现分别记录。方法说明 →

机构与角色

发布机构 METR

引用与复用

引用研究发现时请引用原始出版物；引用 NUWA 的整理与解释时，单独引用本站记录及对应快照。

BibTeX ↓RIS ↓记录与来源元数据 · JSON ↓阅读覆盖 · JSON 提交更正

原始出版物 · BibTeX

@misc{capability-elicitation,
  title = {Guidelines for capability elicitation},
  url = {https://metr.org/blog/2024-03-15-guidelines-for-capability-elicitation/},
  year = {2024},
  date = {2024-03-15},
  version = {Source capture 2026-10-25},
  note = {Source capture 2026-10-25}
}

NUWA 记录 · BibTeX

@misc{capability-elicitation-nuwa,
  title = {Guidelines for capability elicitation — NUWA research record},
  url = {https://whitzard.tech/nuwa/whitzard-index/work/capability-elicitation/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--capability-elicitation.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--capability-elicitation.json.}
}

证据快照 2026-10-29.1 · 索引更新 · RSS

参考文献

[1] Guidelines for capability elicitation. 2024-03-15 ; Official publication masthead and article byline; §1 Overview; §2.1 Basic elicitation