NUWA Evidence record
Kimi K3
EvalAwareBench · Evidence record
Original source charts and materials
EvalAwareBench
Original evaluator results · source order
Select systems
Verbalized awareness, baseline
0–100%
Kimi K3Varies evaluation cues while tracking verbalized evaluation awareness in controlled tasks.
Unexpressed awareness is not measured; recognition of familiar benchmarks can differ from general cue response. Report dates and original executor are shown with this assessment.
Evaluation conditions and system configurations
- Kimi K3
- See the report-specific sample and denominator. · EvalAwareBench
- modelVersion: not specified · harness: not specified · tools: not specified · budget: not specified
| System / configuration | Verbalized awareness, baseline | Verbalized awareness, all eight cues | Publication / verification |
|---|---|---|---|
| Kimi K3Harness not specified | 0.2% | 6.1% | Published2026-09-11 |
Assessment provenance
Evaluating Kimi K3 for Misalignment Risks → · External report
Actual evaluation: Neo Research · Model record →
Method and scope
Varies evaluation cues while tracking verbalized evaluation awareness in controlled tasks.
- Evidence type
- Benchmark
- Assessment subject
- The model or agent in the stated task configuration.
- Primary dimension
- Behavior
- Evidence snapshot
- 2026-10-29.1
The main dimension follows the stated measurement; contextual risk relevance does not establish harmful deployment capability.
Source finding
Source-reported measurements in §2.4.2; blog §3. Transcription is not independent experimental replication.
Limitations
Unexpressed awareness is not measured; recognition of familiar benchmarks can differ from general cue response.
Unexpressed awareness is not measured; recognition of familiar benchmarks can differ from general cue response.
Related research questions
Deception / Evaluation gaming →
The protocol explicitly measures this question or an enabling sub-capability; conclusions retain its stated conditions.
References
- [1] EvalAwareBench
- [2] Evaluating Kimi K3 for Misalignment Risks. 2026-09-11. September 2026 ; §2.4.2; blog §3