WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← NUWA Index

Evidence record

OpenAI o1

Stealth evaluations · Evidence record

Sources and provenance ↓ Read the research narrative →

Original source charts and materials

Reported results

Source order · reported configurations

stealth-evals-m0

0–100
Showing 1 of 1 systems

Values describe the measured outcome under the source protocol, not a general safety score.

Table 1: task-specific success rates with reported 95% confidence intervals. Some tasks do not define success rate and some models lack results; no zero is imputed. Evaluation date not specified; publication / record dates are shown below.

Evaluation conditions and system configurations
OpenAI o1
See the source protocol; no independent trial count inferred. · Table 1 · Stealth evaluations
modelVersion: not specified · harness: not specified · tools: not specified · budget: not specified
Reported results · source order
System / configurationstealth-evals-m0stealth-evals-m1Classifier evasion success rateOversight pattern success ratePublication / verification

Method and scope

Reasoning about oversight and deployment context.

Evidence type
Benchmark
Assessment subject
Model reasoning about oversight and test context
Primary dimension
Capability
Evidence snapshot
2026-10-29.1

Primary dimension follows the source’s measured construct. Metric-level interpretations may differ.

Source finding

Source-reported measurements for OpenAI o1 in Table 1; values are transcribed, not independently reproduced.

Limitations

Prerequisite capability is distinct from a tendency to scheme.

Configuration, task and aggregation differences remain as reported. Source order is retained. Transcription is not independent replication; no cross-protocol ranking is supported.

Related research questions

References

Numerical results are reported by the cited authors.

  1. [1] Mary Phuong, Roland S. Zimmermann, et al.. Evaluating Frontier Models for Stealth and Situational Awareness. 2025-07-03. v4 [arXiv]; Author affiliations on the original paper title page; Table 1