OpenAI

GPT-4 November 2023

Published evidence on capabilities, behavioral tendencies and observed actions.

First public availability: 2023-11-06
Parameters: Not yet verified
Metadata updated: 2026-10-27

Evidence overview

Published risk evidence is organized by assessment and protocol. Missing evidence is not a low-risk finding.

NUWA curates and interprets these sources. Experiments are attributed to their original executors; this page does not claim NUWA has independently replicated them.

MODEL MONITORING

Representative benchmark coverage

Results by protocol and configuration; gaps show records awaiting collection or linkage.

AgentCyberRange →

No eligible measurement linked to this model version.

Cybench →

No eligible measurement linked to this model version.

CyberGym →

No eligible measurement linked to this model version.

METR Time Horizons →

2 measurements

4.04 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react
0.78 minMETR · mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react

SEC-bench Pro →

No eligible measurement linked to this model version.

MASK →

No eligible measurement linked to this model version.

Attempt to Persuade Eval (APE) →

No eligible measurement linked to this model version.

DeceptionBench →

No eligible measurement linked to this model version.

PersuSafety →

No eligible measurement linked to this model version.

All linked measurements

Each result retains its protocol and unit.

2 observations

Measurements and source conditions
System / model	Result	Condition status	Task / conditions	Evaluator / report	Dates
GPT-4 November 2023 · METR scaffoldGPT-4 November 2023	4.04 minMETR Time Horizons · 50% task-completion horizonSource 95% CI [1.866859, 8.443226] min	Incomplete	METR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react	METRMETR Time Horizon 1.1 — source data	Release 2023-11-06Report —
GPT-4 November 2023 · METR scaffoldGPT-4 November 2023	0.78 minMETR Time Horizons · 80% task-completion horizonSource 95% CI [0.276599, 2.358414] min	Incomplete	METR-Horizon-v1.1mtb/start_metr_task,metr_agents/react; ai_rd_fix_embedding/init_solver,use_tools,metr_agents/react; re_bench_common/init_solver,use_tools,metr_agents/react; metr_tasks_swaa/init_solver,generate; metr_agents/react	METRMETR Time Horizon 1.1 — source data	Release 2023-11-06Report —

Developer disclosures

No developer-authored safety report has been linked to this exact model record in the current collection.

External assessments

METR

METR Time Horizon 1.1 →

Estimated task difficulty at 50% and 80% success, measured in human-expert minutes.

Publication date not established

Evidence by risk topic

Autonomy 1 protocol results

METR Time Horizon 1.1 →

External evaluation · Executed by METR

50% task-completion horizon: 4.04 min
80% task-completion horizon: 0.78 min

Task counts/weights vary with source tasks and scaffold coverage; see methodology.

Deception No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Cybersecurity No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

CBRN No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Disinformation No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Autonomous physical harm No structured result linked

A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.

Source review and evidence gaps

Missing scores may reflect unextracted sections, undisclosed configurations, unresolved identity or an absent experiment. These are separate research questions; none implies a zero result.

Interpretation and open questions

Differences between reports can reflect task selection, model endpoints, prompts, budgets, judges and publication dates. Evidence is grouped by the protocol actually used; no model-wide safety grade is inferred.

References

[1] OpenAI DevDay ; Dated launch: GPT-4 Turbo preview available today
[2] METR Time Horizon 1.1 — source data ; results.gpt_4_1106_inspect