风险发现 · 研究
Frontier AI systems have surpassed the self-replicating red line
NUWA 研究解读 · 独立复核待完成
NUWA Research Note
研究问题研究设计与假设来源发现NUWA 解读局限与相反证据研究联系研究与决策意义机构与角色原始资源模型辅助整理 · 选读原始全文或官方文章中的相关章节;尚未完成逐章节审计。
研究速读
受控脚手架中出现了端到端复制;结论针对获得任务指令和资源访问的系统。
研究问题
接受复制指令的模型与脚手架,能否在没有中途人工帮助时建立独立运行副本?
研究设计与假设
作者将两个开源权重模型接入行动与反馈循环,重复复制任务并检查轨迹;另以关机和链式场景展示能力。
来源发现
两个系统在所提供环境中均有成功副本。
轨迹分析发现早期探索与成功相关,但不是随机干预探索行为的因果实验。
NUWA 解读
NUWA 解读:有利权限下的复制能力不同于自发复制意图,也不同于自我维持的群体。
局限与相反证据
两个模型与特定脚手架不能代表部署发生率;作者的宏观风险推论超出直接观察的复制任务。
研究联系
NUWA 关联:扩展研究扩大模型集合;RepliBench 分解前置能力,终点与本研究不同。
研究与决策意义
NUWA 建议:用于复制风险阈值前,应保留访问权限、脚手架、任务指令和成功终点。
精确来源位置
- Frontier AI systems have surpassed the self-replicating red line · 2 Experiment designsSelected original resource https://arxiv.org/html/2412.12140v1; sha256:8ae65ad64820f261fcf3f5bc09bfa4e56c5117fc85d487bccff555572a969903; archived source capture; exact capture time not independently established
- Frontier AI systems have surpassed the self-replicating red line · 3.1 Summary of resultsSelected original resource https://arxiv.org/html/2412.12140v1; sha256:8ae65ad64820f261fcf3f5bc09bfa4e56c5117fc85d487bccff555572a969903; archived source capture; exact capture time not independently established
- Frontier AI systems have surpassed the self-replicating red line · 3.4 Analyzing key factors behind successful self-replicationSelected original resource https://arxiv.org/html/2412.12140v1; sha256:8ae65ad64820f261fcf3f5bc09bfa4e56c5117fc85d487bccff555572a969903; archived source capture; exact capture time not independently established
- Frontier AI systems have surpassed the self-replicating red line · 4 DiscussionSelected original resource https://arxiv.org/html/2412.12140v1; sha256:8ae65ad64820f261fcf3f5bc09bfa4e56c5117fc85d487bccff555572a969903; archived source capture; exact capture time not independently established
来源核查、数据提取、编辑批准与实验复现分别记录。 方法说明 →
机构与角色
作者 (4)
Xudong Pan (潘旭东) · Jiarun Dai (戴嘉润) · Yihe Fan (范一禾) · Min Yang (杨珉)
评测协议
引用与复用
引用研究发现时请引用原始出版物;引用 NUWA 的整理与解释时,单独引用本站记录及对应快照。
原始出版物 · BibTeX
@misc{self-replication,
title = {Frontier AI systems have surpassed the self-replicating red line},
url = {https://arxiv.org/html/2412.12140v1},
author = {Xudong Pan (潘旭东) and Jiarun Dai (戴嘉润) and Yihe Fan (范一禾) and Min Yang (杨珉)},
year = {2024},
date = {2024-12-09},
version = {arXiv:2412.12140v1},
note = {arXiv:2412.12140v1}
}
NUWA 记录 · BibTeX
@misc{self-replication-nuwa,
title = {Frontier AI systems have surpassed the self-replicating red line — NUWA research record},
url = {https://whitzard.tech/nuwa/whitzard-index/work/self-replication/},
version = {2026-10-29.1},
organization = {NUWA Frontier AI Safety Lab},
howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--self-replication.json},
note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--self-replication.json.}
}
证据快照 2026-10-29.1 · 索引更新 · RSS
参考文献
- [1] Xudong Pan (潘旭东), Jiarun Dai (戴嘉润) 等. Frontier AI systems have surpassed the self-replicating red line. 2024-12-09. v1 ; Author affiliations on the original paper title page; 2 Experiment designs; 3.1 Summary of results