Z.ai
GLM-5
Published evidence on capabilities, behavioral tendencies and observed actions.
- First public availability
- 2026-02-12
- Parameters
- 744B · 40B active · MoE
- Metadata updated
- 2026-10-27
Evidence overview
Developer documentation is linked below. Structured risk results have not yet been extracted for this exact model record.
NUWA curates and interprets these sources. Experiments are attributed to their original executors; this page does not claim NUWA has independently replicated them.
MODEL MONITORING
Representative benchmark coverage
Results by protocol and configuration; gaps show records awaiting collection or linkage.
AgentCyberRange →
No eligible measurement linked to this model version.
Cybench →
No eligible measurement linked to this model version.
CyberGym →
1 measurements
- 43.2%Not disclosed · Claude Code
METR Time Horizons →
No eligible measurement linked to this model version.
SEC-bench Pro →
8 measurements
All conditions →MASK →
No eligible measurement linked to this model version.
Attempt to Persuade Eval (APE) →
No eligible measurement linked to this model version.
DeceptionBench →
No eligible measurement linked to this model version.
PersuSafety →
No eligible measurement linked to this model version.
All linked measurements
Each result retains its protocol and unit.
9 observations
| System / model | Result | Condition status | Task / conditions | Evaluator / report | Dates |
|---|---|---|---|---|---|
| 43.2%CyberGym · Success rate | Incomplete | level1score_10Claude Code | Not disclosedCyberGym official leaderboard and machine-data extraction | Release 2026-02-12Report — | |
| 3.8%SEC-bench Pro · Headline success rate | Incomplete | 260617 / overallheadlineHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets.OpenCode | Not disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505 | Release 2026-02-12Report — | |
| 4.1%SEC-bench Pro · Completed-mode success rate | Incomplete | 260617 / overallcompletedHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=null; cap labels do not establish equal token or cost budgets.OpenCode | Not disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505 | Release 2026-02-12Report — | |
| 1.9%SEC-bench Pro · Headline success rate | Incomplete | 260617 / v8headlineHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.OpenCode | Not disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505 | Release 2026-02-12Report — | |
| 2.4%SEC-bench Pro · Completed-mode success rate | Incomplete | 260617 / v8completedHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.OpenCode | Not disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505 | Release 2026-02-12Report — | |
| 5.8%SEC-bench Pro · Headline success rate | Incomplete | 260617 / firefoxheadlineHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.OpenCode | Not disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505 | Release 2026-02-12Report — | |
| 6.2%SEC-bench Pro · Completed-mode success rate | Incomplete | 260617 / firefoxcompletedHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.OpenCode | Not disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505 | Release 2026-02-12Report — | |
| 3.6%SEC-bench Pro · Headline success rate | Incomplete | 260617 / linuxheadlineHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.OpenCode | Not disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505 | Release 2026-02-12Report — | |
| 3.7%SEC-bench Pro · Completed-mode success rate | Incomplete | 260617 / linuxcompletedHeadline UI: fixed budget; Completed UI: within timeout. Published summary timeout_caps=["1.5h"]; cap labels do not establish equal token or cost budgets.OpenCode | Not disclosedSEC-bench Pro official leaderboard: selected 260617 and historical 260505 | Release 2026-02-12Report — |
Developer disclosures
GLM-5: from Vibe Coding to Agentic Engineering →
Developer documentation covering GLM-5.
Publication date not verifiedExternal assessments
CyberGym official snapshot →
Published evaluation results collected from CyberGym, retaining the reported systems and configurations.
Publication date not establishedSEC-bench Pro official snapshot →
Published evaluation results collected from SEC-bench Pro, retaining the reported systems and configurations.
Publication date not establishedEvidence by risk topic
Autonomy No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Deception No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Cybersecurity 9 protocol results
CyberGym · level1 · score_10 →
External evaluation · Executed by
- Success rate
- 43.2%
Per-result sample size not disclosed
SEC-bench Pro · 260617 / overall · headline →
External evaluation · Executed by
- Headline success rate
- 3.8%
13/344
SEC-bench Pro · 260617 / overall · completed →
External evaluation · Executed by
- Completed-mode success rate
- 4.1%
13/314
SEC-bench Pro · 260617 / v8 · headline →
External evaluation · Executed by
- Headline success rate
- 1.9%
2/103
SEC-bench Pro · 260617 / v8 · completed →
External evaluation · Executed by
- Completed-mode success rate
- 2.4%
2/84
SEC-bench Pro · 260617 / firefox · headline →
External evaluation · Executed by
- Headline success rate
- 5.8%
6/104
SEC-bench Pro · 260617 / firefox · completed →
External evaluation · Executed by
- Completed-mode success rate
- 6.2%
6/96
SEC-bench Pro · 260617 / linux · headline →
External evaluation · Executed by
- Headline success rate
- 3.6%
5/137
SEC-bench Pro · 260617 / linux · completed →
External evaluation · Executed by
- Completed-mode success rate
- 3.7%
5/134
CBRN No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Disinformation No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Autonomous physical harm No structured result linked
A gap in this collection is not evidence of low risk. Consult the linked reports for unextracted findings and protocol scope.
Source review and evidence gaps
CyberGym →
Published evaluation results collected from CyberGym, retaining the reported systems and configurations.
The site reports submitted systems under different configurations. Per-row task counts, budgets and execution dates are not fully disclosed. Undefined metrics and unresolved identity rows are excluded. Raw JSON fractions are shown as percentages using ×100 and one-decimal rounding, matching the official renderer.
SEC-bench Pro →
Published evaluation results collected from SEC-bench Pro, retaining the reported systems and configurations.
Headline and Completed apply different inclusion rules and may change both numerator and denominator. Provider and backend labels do not identify the actual evaluator.
Missing scores may reflect unextracted sections, undisclosed configurations, unresolved identity or an absent experiment. These are separate research questions; none implies a zero result.
Interpretation and open questions
Differences between reports can reflect task selection, model endpoints, prompts, budgets, judges and publication dates. Evidence is grouped by the protocol actually used; no model-wide safety grade is inferred.
References
- [1] Z.ai release notes ; GLM-5 entry dated 2026-02-12
- [2] glm-5 developer model card ; Introduction: model scaling
- [3] GLM-5: from Vibe Coding to Agentic Engineering
- [4] CyberGym official leaderboard and machine-data extraction ; /level1/52/score_10
- [5] SEC-bench Pro official leaderboard: selected 260617 and historical 260505 ; /0/results/3/score_modes/headline/score; /0/results/3/score_modes/completed/score; /1/results/3/score_modes/headline/score