风险治理 · 技术报告

The Rogue Replication Threat Model

NUWA 研究解读 · 独立复核待完成

首次发表: 2024-11-12来源核验: 2026-10-25

原始来源 ↗引用本记录 ↓自主性 →

NUWA Research Note

研究问题研究设计与假设来源发现 NUWA 解读局限与相反证据研究联系研究与决策意义机构与角色原始资源

模型辅助整理 · 选读原始全文或官方文章中的相关章节；尚未完成逐章节审计。

研究速读

威胁模型将复制视为多条件情景，并区分排除风险与证明风险。

研究问题

哪些前提让自主复制具有社会后果，评测失败或通过分别意味着什么？

研究设计与假设

METR 提出概念威胁链和候选阈值评测，依据定性论证与专家咨询，而非已完成的基准测试活动。

来源发现

作者更有信心把低于阈值的失败用作排除证据，而非将通过视为大规模持久失控群体的证明。

作者明确降低完整阈值建设优先级，转向通用自主性及本身就值得关注的能力。

NUWA 解读

NUWA 解读：复制模型只是更大威胁论证的一环；能力成功不确立所有下游条件。

局限与相反证据

资源、竞争、关停和危害假设不确定，研究者对关键结果有分歧，候选评测列表不是结果集。

研究联系

NUWA 关联：自复制研究测更窄能力，RepliBench 操作化部分前提但未验证整条威胁故事。

研究与决策意义

NUWA 建议：维护假设图，分别记录实证前提、概念外推与治理判断。

精确来源位置

The Rogue Replication Threat Model · Our ConclusionsSelected original resource https://metr.org/blog/2024-11-12-rogue-replication-threat-model/; sha256:10de61143a14636fbbd3ee12d2a953b443179de74ce4b49f83567063c2fac41f; archived source capture; exact capture time not independently established
The Rogue Replication Threat Model · How We Are Orienting to This Threat StorySelected original resource https://metr.org/blog/2024-11-12-rogue-replication-threat-model/; sha256:10de61143a14636fbbd3ee12d2a953b443179de74ce4b49f83567063c2fac41f; archived source capture; exact capture time not independently established
The Rogue Replication Threat Model · Threshold Evaluations for Rogue Replication: intended evidential roleSelected original resource https://metr.org/blog/2024-11-12-rogue-replication-threat-model/; sha256:10de61143a14636fbbd3ee12d2a953b443179de74ce4b49f83567063c2fac41f; archived source capture; exact capture time not independently established
The Rogue Replication Threat Model · How likely are AI agents that pass this threshold to develop large and robust rogue AI populations?Selected original resource https://metr.org/blog/2024-11-12-rogue-replication-threat-model/; sha256:10de61143a14636fbbd3ee12d2a953b443179de74ce4b49f83567063c2fac41f; archived source capture; exact capture time not independently established
The Rogue Replication Threat Model · ConclusionSelected original resource https://metr.org/blog/2024-11-12-rogue-replication-threat-model/; sha256:10de61143a14636fbbd3ee12d2a953b443179de74ce4b49f83567063c2fac41f; archived source capture; exact capture time not independently established

来源核查、数据提取、编辑批准与实验复现分别记录。方法说明 →

机构与角色

发布机构 METR

引用与复用

引用研究发现时请引用原始出版物；引用 NUWA 的整理与解释时，单独引用本站记录及对应快照。

BibTeX ↓RIS ↓记录与来源元数据 · JSON ↓阅读覆盖 · JSON 提交更正

原始出版物 · BibTeX

@misc{rogue-replication-threat,
  title = {The Rogue Replication Threat Model},
  url = {https://metr.org/blog/2024-11-12-rogue-replication-threat-model/},
  year = {2024},
  date = {2024-11-12},
  version = {Source capture 2026-10-25},
  note = {Source capture 2026-10-25}
}

NUWA 记录 · BibTeX

@misc{rogue-replication-threat-nuwa,
  title = {The Rogue Replication Threat Model — NUWA research record},
  url = {https://whitzard.tech/nuwa/whitzard-index/work/rogue-replication-threat/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--rogue-replication-threat.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--rogue-replication-threat.json.}
}

证据快照 2026-10-29.1 · 索引更新 · RSS

参考文献

[1] The Rogue Replication Threat Model. 2024-11-12 ; Official publication masthead and article byline; Our Conclusions; How We Are Orienting to This Threat Story