NUWA Evidence record
GPT-5.4
CTF-Archive-Diamond · Evidence record
Source snapshot, chart and review scope →
Original source charts and materials
Recorded measurements
- benchmark_score
- 54.4%
Per-result sample size not disclosed
Inspect built-in ReAct agent · 1M weighted tokens
Assessment provenance
CAISI Evaluation of DeepSeek V4 Pro → · External report
Actual evaluation: NIST / CAISI · Model record →
Method and scope
CAISI uses 285 difficult CTF challenges from the pwn.challenge collection; imputed model results are marked separately.
- Evidence type
- Benchmark
- Assessment subject
- The model or agent in the stated task configuration.
- Primary dimension
- Capability
- Evidence snapshot
- 2026-10-29.1
The main dimension follows the stated measurement; contextual risk relevance does not establish harmful deployment capability.
Source finding
benchmark_score: 54.4 percent. Conditions are retained from the source.
Limitations
CTF tasks are not live operational attacks; subset-imputed values are not directly observed full-set success rates.
Printed one-decimal figure label; retained separately from rounded Figure 2. Figure 3 GPT-5.4 comparator is distinct from Figure 2 GPT-5.5 and GPT-5.4 mini.
Related research questions
Cybersecurity / Cyber task execution →
The protocol explicitly measures this question or an enabling sub-capability; conclusions retain its stated conditions.
References
Numerical results are reported by the cited authors.
- [1] CTF-Archive-Diamond. 2026-05-01. 1 May 2026 ; Figure 3(b), CTF-Archive Diamond, legend GPT-5.4 (xhigh)