评测档案
Investigating unintended model actions
记录评测及内部使用中观察到的部分非预期外部行动。
任务与测量
Benchmark 协议档案
- 任务/对象
- 评测及内部使用中的 Claude 智能体
- 测量目标
- 事件式行动轨迹及调查,不提供标准化基准分数。
- 解释边界
- 精选事件不能推断所有部署中的发生率;原文区分不同情境。
测量档案 · NUWA 解读
档案区分来源方法阅读与既有目录信息;已经公开不代表完成独立证据复核或双语编辑复核。
- 测量构念
- 专门网络测试之外出现哪些非预期行动,模糊或不可能任务应如何隔离?
- 任务与样本
- 开发者回溯扫描轨迹并报告精选案例,分类失败、谨慎判断对齐问题,并说明环境、工具与训练修改。
- 判分与失效情形
- 现有材料尚未确定
- 系统条件
- 现有材料尚未确定
- 统计含义
- 现有材料尚未确定
- 效度与解释
- 回溯筛选不能提供总体发生率,删节限制独立重建,部分意图判断仍属暂定。
- 适用研究问题
- NUWA 建议:区分完成任务权限与外部写入权限,检验边界失败并保留带日期勘误。
- Investigating unintended model actions in our evaluations and internal use · Report introduction and transcript-review scopeSelected original resource https://www.anthropic.com/research/investigating-unintended-model-actions; sha256:880cff3b7104f0138a162f35f54a65ba43e60fb1c77ed376ab5c3b15f450c5b1; archived source capture; exact capture time not independently established
- Investigating unintended model actions in our evaluations and internal use · Four categories of unintended actionsSelected original resource https://www.anthropic.com/research/investigating-unintended-model-actions; sha256:880cff3b7104f0138a162f35f54a65ba43e60fb1c77ed376ab5c3b15f450c5b1; archived source capture; exact capture time not independently established
- Investigating unintended model actions in our evaluations and internal use · RemediationSelected original resource https://www.anthropic.com/research/investigating-unintended-model-actions; sha256:880cff3b7104f0138a162f35f54a65ba43e60fb1c77ed376ab5c3b15f450c5b1; archived source capture; exact capture time not independently established
- Investigating unintended model actions in our evaluations and internal use · Alignment considerationsSelected original resource https://www.anthropic.com/research/investigating-unintended-model-actions; sha256:880cff3b7104f0138a162f35f54a65ba43e60fb1c77ed376ab5c3b15f450c5b1; archived source capture; exact capture time not independently established
- Investigating unintended model actions in our evaluations and internal use · Lessons and next steps; corrected 2026-10-12Selected original resource https://www.anthropic.com/research/investigating-unintended-model-actions; sha256:880cff3b7104f0138a162f35f54a65ba43e60fb1c77ed376ab5c3b15f450c5b1; archived source capture; exact capture time not independently established
原始来源图表与材料

相关研究问题
自主性 / 未经授权行动 →
该出版物描述了明确条件下实际发生的行动。
参考文献
- [1] Investigating unintended model actions in our evaluations and internal use. 2026-10-09 article ; Official publication masthead and article byline; Source figure