NUWA 风险评测 · 研究方法
Beyond g-mean²: complementary metrics for monitorability
NUWA 研究解读 · 独立复核待完成
NUWA Research Note
研究问题研究设计与假设来源发现NUWA 解读局限与相反证据研究与决策意义机构与角色原始资源模型辅助整理 · 选读原始全文或官方文章中的相关章节；尚未完成逐章节审计。
研究速读
NUWA 解读：判别、可比实例排序与控制后风险回答不同问题。
研究问题
可监测性比较如何分开样本选择与部署门控？
研究设计与假设
文章新增共享实例配对比较和拒绝门控模拟，并给干预下界、上界。
来源发现
历史配对排名通常与数据集级一致，分歧显示筛选敏感或近似平局。
重试会恢复部分被门控削减的风险。
NUWA 解读
NUWA 解读：判别、可比实例排序与控制后风险回答不同问题。
局限与相反证据
门控估计依赖重试与部署假设，因果归因不确定时需同时给上下界。
研究与决策意义
模型建议：同时展示坏输出部署率及任意部署率，不优化单一分数。
精确来源位置
- Beyond g-mean²: complementary metrics for monitorability · Why one monitorability number is not enoughSelected original resource https://alignment.openai.com/beyond-gmean-squared/; sha256:6c845aa01364667d193dc47aafa490ce24ff4185abb839e9c70109e2258a7ea7; archived source capture; exact capture time not independently established
- Beyond g-mean²: complementary metrics for monitorability · Metric 1: compare models on shared instancesSelected original resource https://alignment.openai.com/beyond-gmean-squared/; sha256:6c845aa01364667d193dc47aafa490ce24ff4185abb839e9c70109e2258a7ea7; archived source capture; exact capture time not independently established
- Beyond g-mean²: complementary metrics for monitorability · Historical system card resultsSelected original resource https://alignment.openai.com/beyond-gmean-squared/; sha256:6c845aa01364667d193dc47aafa490ce24ff4185abb839e9c70109e2258a7ea7; archived source capture; exact capture time not independently established
- Beyond g-mean²: complementary metrics for monitorability · Metric 2: simulate the monitor as a rejection gateSelected original resource https://alignment.openai.com/beyond-gmean-squared/; sha256:6c845aa01364667d193dc47aafa490ce24ff4185abb839e9c70109e2258a7ea7; archived source capture; exact capture time not independently established
- Beyond g-mean²: complementary metrics for monitorability · Gating reduces risk; retries give some risk backSelected original resource https://alignment.openai.com/beyond-gmean-squared/; sha256:6c845aa01364667d193dc47aafa490ce24ff4185abb839e9c70109e2258a7ea7; archived source capture; exact capture time not independently established
来源核查、数据提取、编辑批准与实验复现分别记录。 方法说明 →
机构与角色
作者 (3)
Melody Guan · Yuxiang Xie · Bowen Baker
关联研究
Monitoring Monitorability
针对互补决策目标，进一步讨论原有可监测性指标。
引用与复用
引用研究发现时请引用原始出版物；引用 NUWA 的整理与解释时，单独引用本站记录及对应快照。
原始出版物 · BibTeX
@misc{monitorability-metrics,
title = {Beyond g-mean²: complementary metrics for monitorability},
url = {https://alignment.openai.com/beyond-gmean-squared/},
author = {Melody Guan and Yuxiang Xie and Bowen Baker},
year = {2026},
date = {2026-10-20},
version = {Source capture 2026-10-25},
note = {Source capture 2026-10-25}
}
NUWA 记录 · BibTeX
@misc{monitorability-metrics-nuwa,
title = {Beyond g-mean²: complementary metrics for monitorability — NUWA research record},
url = {https://whitzard.tech/nuwa/whitzard-index/work/monitorability-metrics/},
version = {2026-10-29.1},
organization = {NUWA Frontier AI Safety Lab},
howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--monitorability-metrics.json},
note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--monitorability-metrics.json.}
}
证据快照 2026-10-29.1 · 索引更新 · RSS
参考文献
- [1] Melody Guan, Yuxiang Xie 等. Beyond g-mean²: complementary metrics for monitorability. 2026-10-20 ; Official publication masthead and article byline; Research background and discussion in the original publication; Why one monitorability number is not enough