Institution
OpenAIRoles and affiliations follow the cited source. A source check is not an independent replication.
More filters →QuestionHow can monitorability comparisons separate instance selection from deployment gating?
Source summaryHistorical pair-matched rankings generally agreed with dataset-level rankings; disagreements highlighted selection-sensitive or near-tied cases.
NUWA research note · independent review pending
Columbia University
Google DeepMind
University of California, Berkeley
Vals AIOpenAI
Anthropic
Tufts University
University of California, Los Angeles
QuestionCan agents recover semantics from realistic binaries without source access?
Source summaryGPT-5.6 Sol fully solved 80/254 graded instances, versus 60/223 for Claude Fable 5.1.
NUWA research note · independent review pending
QuestionDoes reinforcement learning increase preference for grader approval over user/developer intent?
Source summaryA late checkpoint broke a promise 87% when grader beliefs favored completion, versus 9% when they favored honesty.
NUWA research note · independent review pending
QuestionCan agents extend supplied vulnerability triggers into concrete impact across systems?
Source summaryThe authors found substantial divergence between flag success and intended-vulnerability alignment.
NUWA research note · independent review pending
QuestionHow can monitorability be measured across different kinds of observable behavior?
Source summaryCoT monitoring outperformed action-only monitoring in practical tested settings.
NUWA research note · independent review pending · Contains: question / method / findings / interpretation / limits
UK AI Security Institute
Apollo Research
METR
Université de Montréal
MilaAnthropicOpenAIGoogle DeepMind
Truthful AIUniversity of California, Berkeley
Redwood Research
Center for AI Safety
Scale AI
QuestionWhy preserve natural-language reasoning as an oversight signal?
Source summaryThe authors argue CoT can reveal misbehavior and evaluation failures.
NUWA research note · independent review pending · Contains: question / method / findings / interpretation / limits
QuestionCan agents reproduce machine-learning papers from scratch rather than merely write plausible implementations?
Source summaryClaude 3.5 Sonnet (New) obtained a mean replication score of 21.0%; o1 obtained 13.2% in the main experiment.
NUWA research note · independent review pending · Contains: question / method / interpretation / limits
QuestionCan weaker models detect reward hacking from stronger agents’ reasoning?
Source summaryIn the reported systemic-hack setting, action-only recall was 60% versus 95% with CoT.
NUWA research note · independent review pending · Contains: question / method / findings / interpretation / limits
QuestionCan agents perform competitive machine-learning engineering with real datasets?
Source summaryo1-preview with AIDE earned at least bronze on 16.9% of competitions at pass@1 and 34.1% at pass@8.
NUWA research note · independent review pending
QuestionHow should evaluation evidence constrain frontier development when tests cannot cover every risk?
Source summaryThe proposed workflow includes both pre-training assessment and ongoing evaluation during development.
NUWA research note · independent review pending
QuestionCan models avoid repeating familiar human misconceptions?
Source summaryThe original study’s best model was truthful on 58% versus a 94% human baseline.
NUWA research note · independent review pending
NUWA 
