WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Models

OpenAI

GPT-4o

Published evidence on capabilities, behavioral tendencies and observed actions.

First public availability
2024-05-13
Parameters
Not disclosed
Metadata updated
2026-10-27
Sources ↓

Evidence overview

Published risk evidence is organized by assessment and protocol. Missing evidence is not a low-risk finding.

NUWA curates and interprets these sources. Experiments are attributed to their original executors; this page does not claim NUWA has independently replicated them.

MODEL MONITORING

Representative benchmark coverage

Results by protocol and configuration; gaps show records awaiting collection or linkage.

Cybench →

No eligible measurement linked to this model version.

CyberGym →

No eligible measurement linked to this model version.

METR Time Horizons →

2 measurements

  • 6.99 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react
  • 1.27 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react

MASK →

No eligible measurement linked to this model version.

All linked measurements

Each result retains its protocol and unit.

3 observations

Measurements and source conditions
System / modelResultCondition statusTask / conditionsEvaluator / reportDates
GPT-4o · METR scaffoldGPT-4o6.99 minMETR Time Horizons · 50% task-completion horizonSource 95% CI [4.001482, 12.905741] minIncompleteMETR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/reactMETRMETR Time Horizon 1.1 — source dataRelease 2024-05-13Report —
GPT-4o · METR scaffoldGPT-4o1.27 minMETR Time Horizons · 80% task-completion horizonSource 95% CI [0.562997, 3.01517] minIncompleteMETR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/reactMETRMETR Time Horizon 1.1 — source dataRelease 2024-05-13Report —
GPT-4o0%Attempt to Persuade Eval (APE) · NoncontroversiallyHarmful acceptance rateIncompleteAPE content with PersuSafety forced gateNoncontroversiallyHarmful acceptance rate—Neo ResearchEvaluating DeepSeek v4 Pro for Frontier RisksRelease 2024-05-13Report 2026-05-29

Developer disclosures

No developer-authored safety report has been linked to this exact model record in the current collection.

External assessments

METR

METR Time Horizon 1.1 →

Estimated task difficulty at 50% and 80% success, measured in human-expert minutes.

Publication date not established

Evidence by risk topic

Autonomy 1 protocol results

METR Time Horizon 1.1 →

External evaluation · Executed by METR

50% task-completion horizon
6.99 min
80% task-completion horizon
1.27 min

Task counts/weights vary with source tasks and scaffold coverage; see methodology.

Deception No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Cybersecurity No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

CBRN No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Disinformation 1 protocol results

APE →

External evaluation · Executed by Neo Research

NoncontroversiallyHarmful acceptance rate
0%

Source denominator: 100 (unit not disclosed)

Autonomous physical harm No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Source review and evidence gaps

Evaluating DeepSeek v4 Pro for Frontier Risks →

Source-specific extraction of Neo Research · DeepSeek V4 Pro. Findings and measurements retain their original attribution.

Source transcription is not experimental replication. Unknown dates, evaluator roles and configuration details remain unknown. Source groups are not verified rankings.

Missing scores may reflect unextracted sections, undisclosed configurations, unresolved identity or an absent experiment. These are separate research questions; none implies a zero result.

Interpretation and open questions

Differences between reports can reflect task selection, model endpoints, prompts, budgets, judges and publication dates. Evidence is grouped by the protocol actually used; no model-wide safety grade is inferred.

References

  1. [1] OpenAI — hello gpt 4o ; Publication date and availability section; Parameter counts not disclosed in launch article
  2. [2] METR Time Horizon 1.1 — source data ; results.gpt_4o_inspect
  3. [3] Evaluating DeepSeek v4 Pro for Frontier Risks. 2026-05-29. v1.1 · 29 May 2026 ; PDF p. 17; APE content with PersuSafety forced gate; NoncontroversiallyHarmful acceptance rate