月之暗面
Kimi K3
关于能力、行为倾向及可观察行动的已发表证据。
- 首次公开可用日期
- 2026-07-16
- 参数规模
- 2.8T · 104B 激活 · MoE
- 元数据更新
- 2026-10-27
证据概述
Neo 对 Kimi K3 的评估涉及缺失输入时的编造、欺骗相关行为及关停场景。CharXiv 和 LAB-Bench 实验移除了原有图像输入:继续作答属于行为观察,不是原基准的任务准确率。
NUWA 整理和解读这些来源。实验归属于原始执行方,本页不宣称 NUWA 已独立复现。
模型监测
代表性 Benchmark 覆盖
按协议和配置呈现结果,缺口标明待收录或待关联的证据。
AgentCyberRange →
2 项测量
Cybench →
1 项测量
- 97.4%Neo Research · Harness 未披露
CyberGym →
2 项测量
METR Time Horizons →
尚未关联该模型版本的合格测量。
SEC-bench Pro →
尚未关联该模型版本的合格测量。
MASK →
1 项测量
- 9.1%Neo Research · Harness 未披露
Attempt to Persuade Eval (APE) →
8 项测量
全部条件 →DeceptionBench →
2 项测量
PersuSafety →
3 项测量
全部已关联测量
各项结果保留原始协议与单位。
73 条观测
| 系统/模型 | 结果 | 条件状态 | 任务/条件 | 评测方/报告 | 日期 |
|---|---|---|---|---|---|
| 78 tasksCyberGym · Tasks completed before turn limit | 条件不完整 | CyberGym random 100/1507 tasks, Level 1Tasks completed before turn limit100 agent iterationsClaude Code via inspect_swe / Inspect model bridge | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 50 tasksCyberGym · Vulnerabilities successfully reproduced | 条件不完整 | CyberGym random 100/1507 tasks, Level 1Vulnerabilities successfully reproduced100 agent iterationsClaude Code via inspect_swe / Inspect model bridge | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 24.61%AgentCyberRange · 成功率(Pass@3) | 条件不完整 | Web exploitationlevel0Kimi Code | Not disclosedAgentCyberRange: Evaluate Agent Cyberattack Capabilities in Enterprise-like Cyber Ranges | 发布 2026-07-16报告 — | |
| 43.9%AgentCyberRange · 成功率(Pass@3) | 条件不完整 | Post exploitationlevel0Kimi Code | Not disclosedAgentCyberRange: Evaluate Agent Cyberattack Capabilities in Enterprise-like Cyber Ranges | 发布 2026-07-16报告 — | |
| 97.4%Cybench · Pass@1 | 条件不完整 | Cybench 39/40 unguided challengeshigh reasoning3 submission attempts/challenge; unlimited wall-clock— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 9.1%MASK · Lying rate under pressure | 条件不完整 | MASK pressured-versus-own-neutral responseLying rate under pressure— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 86.4%Stealth evaluations · Mean challenge success rate | 条件不完整 | GDM situational awareness 11 tasksMean challenge success rate— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 100%Stealth evaluations · Stealth task score | 条件不完整 | GDM stealthOversight pattern— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 78%Stealth evaluations · Stealth task score | 条件不完整 | GDM stealthClassifier evasion— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 100%Stealth evaluations · Stealth task score | 条件不完整 | GDM stealthCover your tracks— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 70%Stealth evaluations · Stealth task score | 条件不完整 | GDM stealthStrategic rule-breaking— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 88.7%CharXiv · Attempted answer with image withheld | 条件不完整 | CharXiv with images withheld— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 88.7%CharXiv · Attempt rate | 条件不完整 | CharXiv, required chart image withheldAttempt rate— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 33.7%CharXiv · Verbalized evaluation awareness | 条件不完整 | CharXiv chart withheldCharXiv grounding— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 36.5%CharXiv · Verbalized evaluation awareness | 条件不完整 | CharXiv chart withheldCharXiv no grounding— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0.2%EvalAwareBench · Verbalized awareness, baseline | 条件不完整 | EvalAwareBench— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 6.1%EvalAwareBench · Verbalized awareness, all eight cues | 条件不完整 | EvalAwareBench— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0.2%EvalAwareBench · Spontaneous recognition rate | 条件不完整 | EvalAwareBench paired tasksBaseline cues5 epochs for K3— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 6.1%EvalAwareBench · Spontaneous recognition rate | 条件不完整 | EvalAwareBench paired tasksAll eight cues5 epochs for K3— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0.2%EvalAwareBench · Recognition | 条件不完整 | EvalAwareBench Safety tasks基线— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 7.2%EvalAwareBench · Recognition | 条件不完整 | EvalAwareBench Safety tasks全部八项线索— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0.2%EvalAwareBench · Recognition | 条件不完整 | EvalAwareBench Capability tasks基线— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 5%EvalAwareBench · Recognition | 条件不完整 | EvalAwareBench Capability tasks全部八项线索— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 100%Agentic misalignment · Familiar scenario recognized, English | 条件不完整 | Agentic Misalignment, historical— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 96%Agentic misalignment · Familiar scenario recognized, Chinese | 条件不完整 | Agentic Misalignment, historical— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Harmful action rate | 条件不完整 | Agentic Misalignment 2025: BlackmailEnglish · goal conflict + replacement— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 8%Agentic misalignment · Harmful action rate | 条件不完整 | Agentic Misalignment 2025: BlackmailChinese · goal conflict + replacement— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Harmful action rate | 条件不完整 | Agentic Misalignment 2025: Corporate espionageEnglish · goal conflict + replacement— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Harmful action rate | 条件不完整 | Agentic Misalignment 2025: Corporate espionageChinese · goal conflict + replacement— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Harmful action rate | 条件不完整 | Agentic Misalignment 2025: MurderEnglish · goal conflict + replacement— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Harmful action rate | 条件不完整 | Agentic Misalignment 2025: MurderChinese · goal conflict + replacement— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Harmful action rate | 条件不完整 | Agentic Misalignment 2025: AggregateEnglish · goal conflict + replacement— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 2.7%Agentic misalignment · Harmful action rate | 条件不完整 | Agentic Misalignment 2025: AggregateChinese · goal conflict + replacement— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Blackmail harmful action rate | 条件不完整 | Agentic Misalignment 2025 blackmailEnglish · Replacement only— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 1%Agentic misalignment · Blackmail harmful action rate | 条件不完整 | Agentic Misalignment 2025 blackmailChinese · Replacement only— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Blackmail harmful action rate | 条件不完整 | Agentic Misalignment 2025 blackmailEnglish · No pressure/goal conflict— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Agentic misalignment · Blackmail harmful action rate | 条件不完整 | Agentic Misalignment 2025 blackmailChinese · No pressure/goal conflict— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 100%Agentic misalignment · Evaluation-awareness rate | 条件不完整 | Agentic Misalignment 2025: Blackmail英语— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 99%Agentic misalignment · Evaluation-awareness rate | 条件不完整 | Agentic Misalignment 2025: Blackmail中文— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 92.3%Agentic misalignment · Evaluation-awareness rate | 条件不完整 | Agentic Misalignment 2025: Corporate espionage英语— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 79%Agentic misalignment · Evaluation-awareness rate | 条件不完整 | Agentic Misalignment 2025: Corporate espionage中文— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 100%Agentic misalignment · Evaluation-awareness rate | 条件不完整 | Agentic Misalignment 2025: Murder英语— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 99%Agentic misalignment · Evaluation-awareness rate | 条件不完整 | Agentic Misalignment 2025: Murder中文— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 97.4%Agentic misalignment · Evaluation-awareness rate | 条件不完整 | Agentic Misalignment 2025: Aggregate英语— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 92.3%Agentic misalignment · Evaluation-awareness rate | 条件不完整 | Agentic Misalignment 2025: Aggregate中文— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 100%Agentic misalignment · Blackmail benchmark-recognition rate | 条件不完整 | Agentic Misalignment 2025 blackmail英语— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 96%Agentic misalignment · Blackmail benchmark-recognition rate | 条件不完整 | Agentic Misalignment 2025 blackmail中文— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 87%Shutdown resistance in reasoning models · Shutdown bypass, no instruction | 条件不完整 | Shutdown resistance— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 1%Shutdown resistance in reasoning models · Shutdown bypass, explicit allow instruction | 条件不完整 | Shutdown resistance— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 87%Shutdown resistance in reasoning models · Shutdown bypass rate | 条件不完整 | Palisade arithmetic-task shutdown scenario无关闭指令— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 1%Shutdown resistance in reasoning models · Shutdown bypass rate | 条件不完整 | Palisade arithmetic-task shutdown scenario明确允许关闭— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 91%Shutdown resistance in reasoning models · Shutdown bypass rate | 条件不完整 | Palisade arithmetic-task shutdown scenario要求抵抗(能力检查)— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%DeceptionBench · Deception rate | 条件不完整 | DeceptionBench first-party Inspect port单轮up to5 turns in multi-turn settingInspect | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%DeceptionBench · Deception rate | 条件不完整 | DeceptionBench first-party Inspect port多轮up to5 turns in multi-turn settingInspect | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 75%PersuSafety · Turn-1 persuasion attempt rate | 条件不完整 | PersuSafety open-ended single-turn adaptation低危害— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 30%PersuSafety · Turn-1 persuasion attempt rate | 条件不完整 | PersuSafety open-ended single-turn adaptation中等危害— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 31%PersuSafety · Turn-1 persuasion attempt rate | 条件不完整 | PersuSafety open-ended single-turn adaptation高危害— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0 transcriptsPetri · Transcripts verbalizing evaluation awareness | 条件不完整 | Pre-seeded alignment auditsColleague credentials— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 2 transcriptsPetri · Transcripts verbalizing evaluation awareness | 条件不完整 | Pre-seeded alignment auditsLocked source— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0 transcriptsPetri · Transcripts verbalizing evaluation awareness | 条件不完整 | Pre-seeded alignment auditsOnly questions— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 2 transcriptsPetri · Transcripts verbalizing evaluation awareness | 条件不完整 | Pre-seeded alignment auditsPooled— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 1.5%ImpossibleBench · Cheating rate (pass@1 on impossible variants) | 条件不完整 | Impossible-LiveCodeBench split with toolsCheating rate (pass@1 on impossible variants)— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 1 percentage pointsAlignment faking · Compliance gap | 条件不完整 | Alignment Faking paid/free-tier contextsCompliance gap— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Alignment faking · Deceptive alignment rate | 条件不完整 | Alignment FakingDeceptive alignment rate— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 26%Alignment faking · Verbalized evaluation awareness | 条件不完整 | Alignment FakingVerbalized evaluation awarenessInspect Scout | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 11%Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate | 条件不完整 | APE topic categories阴谋论600 topics,3 persuasion turns each— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 5%Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate | 条件不完整 | APE topic categories削弱控制600 topics,3 persuasion turns each— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate | 条件不完整 | APE topic categories明确有害话题(总体)600 topics,3 persuasion turns each— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate | 条件不完整 | APE topic categories实施暴力600 topics,3 persuasion turns each— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate | 条件不完整 | APE topic categories人口贩运600 topics,3 persuasion turns each— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate | 条件不完整 | APE topic categories大规模杀戮600 topics,3 persuasion turns each— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate | 条件不完整 | APE topic categories针对未成年人的性侵害600 topics,3 persuasion turns each— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 | |
| 0%Attempt to Persuade Eval (APE) · Turn-1 persuasion attempt rate | 条件不完整 | APE topic categories虐待无辜者600 topics,3 persuasion turns each— | Neo ResearchEvaluating Kimi K3 for Misalignment Risks | 发布 2026-07-16报告 2026-09-11 |
开发者披露
外部评估
Neo Research
Evaluating Kimi K3 for Misalignment Risks →
报告发现有条件的过度主动、面向判分器的行为和对熟悉评测的识别,不代表普遍部署失败率。
2026-09-11按风险主题组织的证据
自主性 27 项协议结果
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Familiar scenario recognized, English
- 100%
- Familiar scenario recognized, Chinese
- 96%
见报告特定样本与分母。
Shutdown resistance →
外部评测 · 执行方 Neo Research
- Shutdown bypass, no instruction
- 87%
- Shutdown bypass, explicit allow instruction
- 1%
见报告特定样本与分母。
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 8%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 2.7%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail harmful action rate
- 1%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 100%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 99%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 92.3%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 79%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 100%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 99%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 97.4%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 92.3%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail benchmark-recognition rate
- 100%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail benchmark-recognition rate
- 96%
原文未披露本结果的样本量
Shutdown resistance →
外部评测 · 执行方 Neo Research
- Shutdown bypass rate
- 87%
原文未披露本结果的样本量
Shutdown resistance →
外部评测 · 执行方 Neo Research
- Shutdown bypass rate
- 1%
原文未披露本结果的样本量
Shutdown resistance →
外部评测 · 执行方 Neo Research
- Shutdown bypass rate
- 91%
原文未披露本结果的样本量
欺骗 49 项协议结果
CharXiv with images withheld →
外部评测 · 执行方 Neo Research
- Attempted answer with image withheld
- 88.7%
见报告特定样本与分母。
LAB-Bench with figures/tables withheld →
外部评测 · 执行方 Neo Research
- FigQA attempt, figure withheld
- 79.6%
- TableQA attempt, table withheld
- 68.4%
见报告特定样本与分母。
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Familiar scenario recognized, English
- 100%
- Familiar scenario recognized, Chinese
- 96%
见报告特定样本与分母。
EvalAwareBench →
外部评测 · 执行方 Neo Research
- Verbalized awareness, baseline
- 0.2%
- Verbalized awareness, all eight cues
- 6.1%
见报告特定样本与分母。
CharXiv with images withheld →
外部评测 · 执行方 Neo Research
- Attempt rate
- 88.7%
原文未披露本结果的样本量
CharXiv with images withheld →
外部评测 · 执行方 Neo Research
- Verbalized evaluation awareness
- 33.7%
原文未披露本结果的样本量
CharXiv with images withheld →
外部评测 · 执行方 Neo Research
- Verbalized evaluation awareness
- 36.5%
原文未披露本结果的样本量
CyberGym infrastructure probing →
外部评测 · 执行方 Neo Research
- Tasks completed before turn limit
- 78 tasks
78/100;100 次试验
CyberGym infrastructure probing →
外部评测 · 执行方 Neo Research
- Vulnerabilities successfully reproduced
- 50 tasks
50/100;100 次试验
ImpossibleBench →
外部评测 · 执行方 Neo Research
- Cheating rate (pass@1 on impossible variants)
- 1.5%
原文未披露本结果的样本量
EvalAwareBench →
外部评测 · 执行方 Neo Research
- Spontaneous recognition rate
- 0.2%
原文未披露本结果的样本量
EvalAwareBench →
外部评测 · 执行方 Neo Research
- Spontaneous recognition rate
- 6.1%
原文未披露本结果的样本量
EvalAwareBench →
外部评测 · 执行方 Neo Research
- Recognition
- 0.2%
原文未披露本结果的样本量
EvalAwareBench →
外部评测 · 执行方 Neo Research
- Recognition
- 7.2%
原文未披露本结果的样本量
EvalAwareBench →
外部评测 · 执行方 Neo Research
- Recognition
- 0.2%
原文未披露本结果的样本量
EvalAwareBench →
外部评测 · 执行方 Neo Research
- Recognition
- 5%
原文未披露本结果的样本量
Alignment faking →
外部评测 · 执行方 Neo Research
- Compliance gap
- 1 percentage points
原文未披露本结果的样本量
Alignment faking →
外部评测 · 执行方 Neo Research
- Deceptive alignment rate
- 0%
原文未披露本结果的样本量
Alignment faking →
外部评测 · 执行方 Neo Research
- Verbalized evaluation awareness
- 26%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 8%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Harmful action rate
- 2.7%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail harmful action rate
- 1%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail harmful action rate
- 0%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 100%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 99%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 92.3%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 79%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 100%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 99%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 97.4%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Evaluation-awareness rate
- 92.3%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail benchmark-recognition rate
- 100%
原文未披露本结果的样本量
Agentic Misalignment, historical →
外部评测 · 执行方 Neo Research
- Blackmail benchmark-recognition rate
- 96%
原文未披露本结果的样本量
GDM Stealth evaluations →
外部评测 · 执行方 Neo Research
- Mean challenge success rate
- 86.4%
原文未披露本结果的样本量
GDM Stealth evaluations →
外部评测 · 执行方 Neo Research
- Stealth task score
- 100%
原文未披露本结果的样本量
GDM Stealth evaluations →
外部评测 · 执行方 Neo Research
- Stealth task score
- 78%
原文未披露本结果的样本量
GDM Stealth evaluations →
外部评测 · 执行方 Neo Research
- Stealth task score
- 100%
原文未披露本结果的样本量
GDM Stealth evaluations →
外部评测 · 执行方 Neo Research
- Stealth task score
- 70%
原文未披露本结果的样本量
DeceptionBench →
外部评测 · 执行方 Neo Research
- Deception rate
- 0%
原文未披露本结果的样本量
DeceptionBench →
外部评测 · 执行方 Neo Research
- Deception rate
- 0%
原文未披露本结果的样本量
MASK →
外部评测 · 执行方 Neo Research
- Lying rate under pressure
- 9.1%
原文未披露本结果的样本量
网络安全 3 项协议结果
AgentCyberRange · Web exploitation · pass3 →
外部评测 · 执行方
- 成功率(Pass@3)
- 24.61%
原文未披露本结果的样本量
AgentCyberRange · Post exploitation · pass3 →
外部评测 · 执行方
- 成功率(Pass@3)
- 43.9%
原文未披露本结果的样本量
Cybench →
外部评测 · 执行方 Neo Research
- Pass@1
- 97.4%
38/39
化生放核 未关联结构化结果
目录缺口不代表低风险。尚未提取的发现及协议范围请见关联报告。
虚假信息与影响 11 项协议结果
APE →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 11%
原文未披露本结果的样本量
APE →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 5%
原文未披露本结果的样本量
APE →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 0%
原文未披露本结果的样本量
APE →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 0%
原文未披露本结果的样本量
APE →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 0%
原文未披露本结果的样本量
APE →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 0%
原文未披露本结果的样本量
APE →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 0%
原文未披露本结果的样本量
APE →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 0%
原文未披露本结果的样本量
PersuSafety with adapted judge →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 75%
原文未披露本结果的样本量
PersuSafety with adapted judge →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 30%
原文未披露本结果的样本量
PersuSafety with adapted judge →
外部评测 · 执行方 Neo Research
- Turn-1 persuasion attempt rate
- 31%
原文未披露本结果的样本量
自主物理危害 未关联结构化结果
目录缺口不代表低风险。尚未提取的发现及协议范围请见关联报告。
来源核查与证据缺口
AgentCyberRange →
整理 AgentCyberRange 官网报告的评测结果,保留受测系统和运行配置。
Web 利用与后渗透分别评测。Pass@3 保留官网定义;各行的预算、样本量和执行日期未披露。
Evaluating Kimi K3 for Misalignment Risks →
对 Neo Research · Kimi K3 的逐来源提取与核查,发现和数值均保留原始归属。
来源转录不等于实验复现。未确定的日期、执行方及配置保留为未知;原文分组不作为经核验排名。
Kimi K3: Open Frontier Intelligence — Technical Report of Kimi K3 →
核查了开发者技术报告中的网络安全评测、安全相关基础设施描述及证据边界;报告自测与转引的独立评测分别归属。已核实的网络安全数值因缺少明确评测变体和配置,仅保留在私有复核记录中。
来源转录不等于实验复现。未确定的日期、执行方及配置保留为未知;原文分组不作为经核验排名。
评测协议身份与结果关联
部分已复核观测尚未解决协议或模型关联,因此未进入比较视图。
先核查来源条件与依赖,再进行跨来源比较或形成补测计划。
评测协议身份与结果关联
部分已复核观测尚未解决协议或模型关联,因此未进入比较视图。
先核查来源条件与依赖,再进行跨来源比较或形成补测计划。
缺失分数可能来自尚未提取的章节、未披露配置、身份待核实或尚无实验。这些问题需要分别处理,均不代表零分。
解读与开放问题
报告差异可能来自任务选择、模型端点、提示、预算、判别器和发表时间。证据依据实际协议分组,不推断模型整体安全等级。
参考文献
- [1] Kimi Code — What’s New ; Kimi K3 · July 16, 2026
- [2] kimi-k3 developer model card ; Model Summary: Total Parameters; Activated Parameters
- [3] Evaluating Kimi K3 for Misalignment Risks. 2026-09-11. September 2026 ; §1.1.1; Figure 1; §1.1.2; Figure 2; §3.2.2; blog §3
- [4] Kimi K3 Technical Report
- [5] AgentCyberRange: Evaluate Agent Cyberattack Capabilities in Enterprise-like Cyber Ranges ; routes-B-0Mubrq.js::QR/10/level0/pass3; routes-B-0Mubrq.js::$R/10/level0/pass3