NUWA 
OpenAI
GPT-5.4 mini
Published evidence on capabilities, behavioral tendencies and observed actions.
- First public availability
- 2026-03-17
- Parameters
- Not disclosed
- Metadata updated
- 2026-10-27
Evidence overview
Published risk evidence is organized by assessment and protocol. Missing evidence is not a low-risk finding.
NUWA curates and interprets these sources. Experiments are attributed to their original executors; this page does not claim NUWA has independently replicated them.
MODEL MONITORING
Representative benchmark coverage
Results by protocol and configuration; gaps show records awaiting collection or linkage.
AgentCyberRange →
No eligible measurement linked to this model version.
Cybench →
No eligible measurement linked to this model version.
CyberGym →
No eligible measurement linked to this model version.
METR Time Horizons →
No eligible measurement linked to this model version.
SEC-bench Pro →
No eligible measurement linked to this model version.
MASK →
No eligible measurement linked to this model version.
Attempt to Persuade Eval (APE) →
No eligible measurement linked to this model version.
DeceptionBench →
No eligible measurement linked to this model version.
PersuSafety →
No eligible measurement linked to this model version.
All linked measurements
Each result retains its protocol and unit.
3 observations
| System / model | Result | Condition status | Task / conditions | Evaluator / report | Dates |
|---|---|---|---|---|---|
| GPT-5.4 mini (xhigh)GPT-5.4 mini | 32%CTF-Archive-Diamond · Task accuracy | Incomplete | CTF-Archive-Diamond1M weighted tokensInspect ReAct | NIST / CAISICAISI Evaluation of DeepSeek V4 Pro | Release 2026-03-17Report 2026-05-01 |
| OpenAI GPT-5.4 miniGPT-5.4 mini | 32%CTF-Archive-Diamond · benchmark_score | Incomplete | CTF-Archive-Diamondxhigh1M weighted tokensInspect built-in ReAct agent | NIST / CAISICAISI Evaluation of DeepSeek V4 Pro | Release 2026-03-17Report 2026-05-01 |
| GPT-5.4 mini (xhigh)GPT-5.4 mini | 41%PortBench · Reported task accuracy | Incomplete | PortBench1M weighted tokensInspect ReAct | NIST / CAISICAISI Evaluation of DeepSeek V4 Pro | Release 2026-03-17Report 2026-05-01 |
Developer disclosures
No developer-authored safety report has been linked to this exact model record in the current collection.
External assessments
NIST / CAISI
CAISI Evaluation of DeepSeek V4 Pro →
The assessment reports benchmark-specific performance and an IRT aggregate; the latter is not a frontier-risk score.
2026-05-01Evidence by risk topic
Autonomy 1 protocol results
PortBench →
External evaluation · Executed by NIST / CAISI
- Reported task accuracy
- 41%
Non-public CAISI task set; report describes continuous scoring.
Deception No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Cybersecurity 2 protocol results
CTF-Archive-Diamond →
External evaluation · Executed by NIST / CAISI
- Task accuracy
- 32%
285 difficult CTF tasks; DeepSeek score is imputed from a subset.
CTF-Archive-Diamond →
External evaluation · Executed by NIST / CAISI
- benchmark_score
- 32%
Per-result sample size not disclosed
CBRN No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Disinformation No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Autonomous physical harm No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Source review and evidence gaps
CAISI Evaluation of DeepSeek V4 Pro →
Source-specific extraction of CAISI · DeepSeek V4 Pro. Findings and measurements retain their original attribution.
Source transcription is not experimental replication. Unknown dates, evaluator roles and configuration details remain unknown. Source groups are not verified rankings.
Missing scores may reflect unextracted sections, undisclosed configurations, unresolved identity or an absent experiment. These are separate research questions; none implies a zero result.
Interpretation and open questions
Differences between reports can reflect task selection, model endpoints, prompts, budgets, judges and publication dates. Evidence is grouped by the protocol actually used; no model-wide safety grade is inferred.
References
- [1] OpenAI — introducing gpt 5 4 mini and nano ; Publication date and availability section; Parameter counts not disclosed in launch article
- [2] CAISI Evaluation of DeepSeek V4 Pro. 2026-05-01. 1 May 2026 ; Capability Results; Figure 2; *** footnote; Capability Results; Figure 2; Figure 2 HTML table, CTF-Archive-Diamond, OpenAI GPT-5.4 mini (xhigh)