风险评测 · 评测基准

CTF-Archive-Diamond

NUWA 研究解读 · 独立复核待完成

首次发表: 2026-05-01来源核验: 2026-10-25

原始来源 ↗引用本记录 ↓网络安全 →

NUWA Research Note

研究问题研究设计与假设来源发现 NUWA 解读局限与相反证据研究与决策意义机构与角色原始资源

模型辅助整理 · 选读原始全文或官方文章中的相关章节；尚未完成逐章节审计。

研究速读

NUWA 解读：285题规模不是DeepSeek直接试验分母。

研究问题

受控预算下模型在CAISI较难CTF集合表现如何？

研究设计与假设

官网报告描述285道pwn.challenge来源题，使用Inspect ReAct及百万加权令牌预算。

来源发现

报告列GPT-5.5为71%，Opus 4.6为46%，DeepSeek V4 Pro为32%。

DeepSeek标星结果由子样本IRT推补，不是全题直接观测。

NUWA 解读

NUWA 解读：285题规模不是DeepSeek直接试验分母。

局限与相反证据

报告仅简述基准，此处未审查全部试次、保留来源及推补输入。

研究与决策意义

模型建议：比较独立CTF结果前保留推补注释与预算。

精确来源位置

CTF-Archive-Diamond · Capability Results: Figure 2 and *** footnoteSelected original resource https://www.nist.gov/news-events/news/2026/05/caisi-evaluation-deepseek-v4-pro; sha256:37f75aab5640e04d198b94a0ca57704b06d7823caeeb05c4280c8fc461b00623; archived source capture; exact capture time not independently established
CTF-Archive-Diamond · Benchmarks: CTF-Archive-DiamondSelected original resource https://www.nist.gov/news-events/news/2026/05/caisi-evaluation-deepseek-v4-pro; sha256:37f75aab5640e04d198b94a0ca57704b06d7823caeeb05c4280c8fc461b00623; archived source capture; exact capture time not independently established
CTF-Archive-Diamond · Capability Lag Measurement: token budgetsSelected original resource https://www.nist.gov/news-events/news/2026/05/caisi-evaluation-deepseek-v4-pro; sha256:37f75aab5640e04d198b94a0ca57704b06d7823caeeb05c4280c8fc461b00623; archived source capture; exact capture time not independently established
CTF-Archive-Diamond · Appendix: IRTSelected original resource https://www.nist.gov/news-events/news/2026/05/caisi-evaluation-deepseek-v4-pro; sha256:37f75aab5640e04d198b94a0ca57704b06d7823caeeb05c4280c8fc461b00623; archived source capture; exact capture time not independently established

来源核查、数据提取、编辑批准与实验复现分别记录。方法说明 →

机构与角色

原文未注明机构

评测协议

CTF-Archive-Diamond →

引用与复用

引用研究发现时请引用原始出版物；引用 NUWA 的整理与解释时，单独引用本站记录及对应快照。

BibTeX ↓RIS ↓记录与来源元数据 · JSON ↓阅读覆盖 · JSON 提交更正

原始出版物 · BibTeX

@misc{ctf-archive-diamond,
  title = {CTF-Archive-Diamond},
  url = {https://www.nist.gov/news-events/news/2026/05/caisi-evaluation-deepseek-v4-pro},
  year = {2026},
  date = {2026-05-01},
  version = {2026-10-25 source capture},
  note = {2026-10-25 source capture}
}

NUWA 记录 · BibTeX

@misc{ctf-archive-diamond-nuwa,
  title = {CTF-Archive-Diamond — NUWA research record},
  url = {https://whitzard.tech/nuwa/whitzard-index/work/ctf-archive-diamond/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--ctf-archive-diamond.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--ctf-archive-diamond.json.}
}

证据快照 2026-10-29.1 · 索引更新 · RSS

参考文献

[1] CTF-Archive-Diamond. 2026-05-01 ; Capability Results: Figure 2 and *** footnote; Benchmarks: CTF-Archive-Diamond; Capability Lag Measurement: token budgets