Evidence record
OpenAI o1
Stealth evaluations · Evidence record
Original source charts and materials
Reported results
Source order · reported configurations
Select systems
stealth-evals-m0
0–100Values describe the measured outcome under the source protocol, not a general safety score.
Table 1: task-specific success rates with reported 95% confidence intervals. Some tasks do not define success rate and some models lack results; no zero is imputed. Evaluation date not specified; publication / record dates are shown below.
Evaluation conditions and system configurations
- OpenAI o1
- See the source protocol; no independent trial count inferred. · Table 1 · Stealth evaluations
- modelVersion: not specified · harness: not specified · tools: not specified · budget: not specified
| System / configuration | stealth-evals-m0 | stealth-evals-m1 | Classifier evasion success rate | Oversight pattern success rate | Publication / verification |
|---|
Method and scope
Reasoning about oversight and deployment context.
- Evidence type
- Benchmark
- Assessment subject
- Model reasoning about oversight and test context
- Primary dimension
- Capability
- Evidence snapshot
- 2026-10-29.1
Primary dimension follows the source’s measured construct. Metric-level interpretations may differ.
Source finding
Source-reported measurements for OpenAI o1 in Table 1; values are transcribed, not independently reproduced.
Limitations
Prerequisite capability is distinct from a tendency to scheme.
Configuration, task and aggregation differences remain as reported. Source order is retained. Transcription is not independent replication; no cross-protocol ranking is supported.
Related research questions
Deception / Evaluation gaming →
The source measures a prerequisite capability; it does not show the risk behavior.
References
Numerical results are reported by the cited authors.
- [1] Mary Phuong, Roland S. Zimmermann, et al.. Evaluating Frontier Models for Stealth and Situational Awareness. 2025-07-03. v4 [arXiv]; Author affiliations on the original paper title page; Table 1