DeepSeek-V4-Flash / Claude Code 2.1.226

方法与范围

Web 利用与后渗透任务表现；每项提交分别核查配置。

证据类型

可复用基准

评测对象

AI 智能体完成靶场任务

主观测维度

Capability · 任务能力

证据快照

2026-10-29.1

主维度依据来源实际测量的构念；具体指标可能属于其他维度。

来源结论

成功率（Pass@3）：28.46 %；保留来源条件。

适用限制

任务集与提交配置变化，不支持无条件比较。

Web 利用与后渗透分别评测。Pass@3 保留官网定义；各行的预算、样本量和执行日期未披露。 本条限制说明（英文，完整保留）：Pass@3 is preserved as an author-defined metric, not interpreted as a disclosed number of independent trials. Only explicitly displayed score fields are included; top-level aliases are not independent results. The source model label is not a verified model endpoint. Row sample counts, budgets and execution dates remain unknown. Source-reported website value; no NUWA experimental replication or receipt. No row-specific evaluation date, exact model API/snapshot identifier, trial count, numerator, denominator, or budget is disclosed in these leaderboard records.

相关研究问题