来源档案
SEC-bench Pro
整理 SEC-bench Pro 官网报告的评测结果,保留受测系统和运行配置。
评测结果
筛选系统与配置
数据报告方: SEC-bench Pro website · 实际执行方: 各提交的执行方未完整确定 · 抓取时间: 2026-10-26
Headline 与 Completed 使用不同纳入规则,分子与分母都可能变化。模型提供方及服务后端不等于实际评测方。
图表按来源顺序展示 6/6 个系统
Headline 成功率 · 260617 / overall
GPT-5.558.4%Codex · Headline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · 201/344
GPT-5.439%Codex · Headline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · 134/344
Opus 4.630.8%Claude Code · Headline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · 106/344
GLM-53.8%OpenCode · Headline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · 13/344
Kimi K2.52.3%OpenCode · Headline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · 8/344
MiniMax M2.50.6%OpenCode · Headline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · 2/344
| 系统 | 结果 | 任务集/模式 | 运行配置 | 日期/归属 |
|---|---|---|---|---|
| 58.4%201/344 | 260617 / overallheadline | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 60.3%199/330 | 260617 / overallcompleted | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 39%134/344 | 260617 / overallheadline | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 40.5%132/326 | 260617 / overallcompleted | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 30.8%106/344 | 260617 / overallheadline | Claude CodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 72.8%99/136 | 260617 / overallcompleted | Claude CodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 3.8%13/344 | 260617 / overallheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 4.1%13/314 | 260617 / overallcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 2.3%8/344 | 260617 / overallheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 2.3%8/341 | 260617 / overallcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 0.6%2/344 | 260617 / overallheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 0.6%2/330 | 260617 / overallcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 47.6%49/103 | 260617 / v8headline | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 48%49/102 | 260617 / v8completed | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 35%36/103 | 260617 / v8headline | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.3h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 36.7%36/98 | 260617 / v8completed | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.3h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 22.3%23/103 | 260617 / v8headline | Claude CodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 61.1%22/36 | 260617 / v8completed | Claude CodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 1.9%2/103 | 260617 / v8headline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 2.4%2/84 | 260617 / v8completed | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 1.9%2/103 | 260617 / v8headline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 2%2/101 | 260617 / v8completed | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 0%0/103 | 260617 / v8headline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 0%0/98 | 260617 / v8completed | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 44.2%46/104 | 260617 / firefoxheadline | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 44.7%46/103 | 260617 / firefoxcompleted | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 25%26/104 | 260617 / firefoxheadline | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=[]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 25%26/104 | 260617 / firefoxcompleted | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=[]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 27.9%29/104 | 260617 / firefoxheadline | Claude CodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 58.1%25/43 | 260617 / firefoxcompleted | Claude CodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 5.8%6/104 | 260617 / firefoxheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 6.2%6/96 | 260617 / firefoxcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 2.9%3/104 | 260617 / firefoxheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 2.9%3/103 | 260617 / firefoxcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 0%0/104 | 260617 / firefoxheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 0%0/100 | 260617 / firefoxcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 77.4%106/137 | 260617 / linuxheadline | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 83.2%104/125 | 260617 / linuxcompleted | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 52.6%72/137 | 260617 / linuxheadline | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 56.5%70/124 | 260617 / linuxcompleted | CodexHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 39.4%54/137 | 260617 / linuxheadline | Claude CodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 91.2%52/57 | 260617 / linuxcompleted | Claude CodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 3.6%5/137 | 260617 / linuxheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 3.7%5/134 | 260617 / linuxcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 2.2%3/137 | 260617 / linuxheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=[]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 2.2%3/137 | 260617 / linuxcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=[]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 1.5%2/137 | 260617 / linuxheadline | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 | |
| 1.5%2/132 | 260617 / linuxcompleted | OpenCodeHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets. · ? 次尝试 | 2026-06-17来源行日期;含义未明确 · SEC-bench Pro website · 执行方: 未注明 |
范围与归属
- 数据报告方
- SEC-bench Pro website
- 实际评测方
- 各观测的执行方未完整确定
- 抓取版本
- 2026-10-26
- 来源身份
- a2c735df11620c32
Headline 与 Completed 使用不同纳入规则,分子与分母都可能变化。模型提供方及服务后端不等于实际评测方。
来源发现
以下陈述整理自原始来源,未作为 NUWA 独立实验结论。
当前选中的快照 260617 包含 344 个 Overall 实例,分别为 V8 103 个、Firefox 104 个和 Linux 137 个。
official-root embedded /0/instances,/1/instances,/2/instances,/3/instances结论范围限于原始来源的任务与实验条件;原文定位保留供核查。
历史快照 260505 包含 183 个 Overall 实例,其中 V8 103 个、Firefox 80 个,没有 Linux 任务线。
official-260505 embedded /0/instances,/1/instances,/2/instances and selected version option结论范围限于原始来源的任务与实验条件;原文定位保留供核查。
Headline 口径包含全部实例;Completed 口径排除轨迹中带有超时标记的实例,这些实例中的成功结果也会一并排除。
official-v8-opus-detail.html:97-138; official-root embedded /0/results/2/score_modes结论范围限于原始来源的任务与实验条件;原文定位保留供核查。
页面中的 Provider 列来自 org 字段;Backend 和智能体框架是另外的字段。来源未披露各条记录的实际评测执行方。
official-root.html Pro table headers; embedded /0/results/*/org,/backend,/agent结论范围限于原始来源的任务与实验条件;原文定位保留供核查。
GPT-5.4 的 V8 汇总中,timeout_caps 为 ["1.3h"];其他多数非空数组为 ["1.5h"],因此不能为所有记录假定统一时限。
official-root embedded /1/results/1/details_summary/timeout_caps结论范围限于原始来源的任务与实验条件;原文定位保留供核查。
发布方说明,受安全防护限制,较新的 Claude Opus 和 Mythos 模型结果暂不可用。
official-root embedded /0/footnotes/0结论范围限于原始来源的任务与实验条件;原文定位保留供核查。
Pro 新闻栏目将 Overall 和 Linux 榜单的公告日期列为 2026 年 6 月 17 日,SpiderMonkey 为 5 月 5 日,V8 首次发布为 5 月 1 日。这些公告日期与记录中的日期及抓取时间不同。
official-root Pro info_sections/News结论范围限于原始来源的任务与实验条件;原文定位保留供核查。
页面默认使用 Headline 口径,并选择对应口径的分数与排名;可见行排序时保留来源给出的排名标签。历史版本缺少目标任务线时,版本控件会回退到 Overall。
official-renderer.js:6,63-111,211-259,280-344结论范围限于原始来源的任务与实验条件;原文定位保留供核查。
提取范围
以下条目说明来源各部分的处理状态。个别观测已核验,不代表整份文档的全部结论和结果均已验证。
查看 14 项覆盖记录
| 章节 | 处理状态 | 定位与范围 |
|---|---|---|
| SEC-bench Pro / snapshot 260617 / overall | extracted | https://sec-bench.github.io/ script#leaderboard-data /0All 6 source rows and both scoring modes extracted; snapshot instance count 344; all numeric details_summary fields retained independently. Historical snapshot is not an independently captured historical-day result. |
| SEC-bench Pro / snapshot 260617 / v8 | extracted | https://sec-bench.github.io/ script#leaderboard-data /1All 6 source rows and both scoring modes extracted; snapshot instance count 103; all numeric details_summary fields retained independently. Historical snapshot is not an independently captured historical-day result. |
| SEC-bench Pro / snapshot 260617 / firefox | extracted | https://sec-bench.github.io/ script#leaderboard-data /2All 6 source rows and both scoring modes extracted; snapshot instance count 104; all numeric details_summary fields retained independently. Historical snapshot is not an independently captured historical-day result. |
| SEC-bench Pro / snapshot 260617 / linux | extracted | https://sec-bench.github.io/ script#leaderboard-data /3All 6 source rows and both scoring modes extracted; snapshot instance count 137; all numeric details_summary fields retained independently. Historical snapshot is not an independently captured historical-day result. |
| SEC-bench Pro / snapshot 260505 / overall | extracted | https://sec-bench.github.io/260505/ script#leaderboard-data /0All 6 source rows and both scoring modes extracted; snapshot instance count 183; all numeric details_summary fields retained independently. Historical snapshot is not an independently captured historical-day result. |
| SEC-bench Pro / snapshot 260505 / v8 | reused | https://sec-bench.github.io/260505/ script#leaderboard-data /1All 6 source rows and both scoring modes extracted; snapshot instance count 103; all numeric details_summary fields retained independently. Historical snapshot is not an independently captured historical-day result. |
| SEC-bench Pro / snapshot 260505 / firefox | extracted | https://sec-bench.github.io/260505/ script#leaderboard-data /2All 6 source rows and both scoring modes extracted; snapshot instance count 80; all numeric details_summary fields retained independently. Historical snapshot is not an independently captured historical-day result. |
| Original SEC-bench classic tables | not-relevant | official-root.html [data-mode-panel="classic"]; embedded /4 and /5Original PoC Generation and Vulnerability Patching tables excluded; their mode definitions, dates and scores do not apply to Pro. |
| Renderer semantics | extracted | official-renderer.js:6,63-111,211-259,280-344Headline default; mode switch reads mode-specific score/rank/count, changes bar titles/widths, and re-sorts. Rank labels retain source mode rank. Missing selected target falls back to Overall, not a new target result. Presentation widths are not benchmark metrics. |
| Headline and Completed definitions | qualitative | official-v8-opus-detail.html:97-138Detail labels all instances vs exclude timeout markers; timeout uses per-instance marker under trajectory artifact. Only definition and aggregate context used, no per-instance extraction. |
| Safeguard-restricted newer Claude Opus/Mythos rows | unavailable | official-root embedded /0/footnotes/0 (repeated on each Pro track)Publisher states newer results unavailable due to safeguards. No numeric score assigned, no versions invented. |
| Executor, exact scaffold versions and universal budget | not-disclosed | All Pro results; details_summary timeout_capsExecutor/evaluator identity and exact agent/backend software versions absent. Overall has no timeout-cap summary. No equal-token/equal-cost or universal 1.5h assertion. |
| Snapshot identifiers, row date and publication metadata | extracted | official-root.html version options and Pro News; all Pro /results/*/date; capture-log.jsonBoth snapshots rows date 2026-06-17; historical 260505 is a selectable snapshot ID, not proof of evaluation date. HTTP Last-Modified 2026-07-09 is transport metadata, not asserted as publication/revision date. |
| Per-instance runs, trajectories, exploit tasks, paper | not-relevant | Scope boundaryOnly leaderboard aggregates, exact embedded summary fields, renderer and mode definition extracted. No per-instance operational exploit content or external paper result extraction. |
来源待核实事项
Headline 与 Completed 使用不同样本集合,分子和分母都可能改变,不能直接将分数差异解释为能力变化。
来源未披露各条结果的实际执行方;日期标签与快照编号不代表已核实的实验时间。
版本指纹
https://sec-bench.github.io/
e01142eb1af97dfc56ba68467ac87971a9f2377e922cc33bf34b1bcc679a90e5https://sec-bench.github.io/js/leaderboard.js?v=6
a5f2e7a0f2eb04e4fc1da6eb41d08b7ffb91d3f4a984ba0044afda9bd3be9f46https://sec-bench.github.io/260505/
53f9744c15a073f287298fa221028fbac9ac137ea2d0f7f2b037adb85babf9e3https://sec-bench.github.io/v8/runs/claude_opus-4.6-max/
4a71cc599862afdf583b366563ccccea8f2a4b30b77f08f8bfff8fe99c276e2ehttps://sec-bench.github.io/#leaderboard-data
6d2e9bdd9cbe11bca1b7e2e490f18fc3f7fc251f374a119d54d4ac8ac5189708https://sec-bench.github.io/260505/#leaderboard-data
e16da95f7fb33b8fd3b74400235567f28e7ba088ef9f2a29f7c16b8806156c07参考文献
数值结果由所引研究的作者报告。