WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Library

Institution

Redwood Research

Roles and affiliations follow the cited source. A source check is not an independent replication.

More filters →

Redwood Research ↗

BashArena: A Control Setting for Highly Privileged AI Agents

QuestionHow well can agents perform useful privileged work, sabotage it, and detect sabotage in a common environment?

Source summaryThe reported safety metric excludes undetected unsuccessful attacks from its denominator.

NUWA research note · independent review pending · Contains: question / method / findings / interpretation / limits / connections

Risk EvaluationTechnical report

Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety

QuestionWhy preserve natural-language reasoning as an oversight signal?

Source summaryThe authors argue CoT can reveal misbehavior and evaluation failures.

NUWA research note · independent review pending · Contains: question / method / findings / interpretation / limits

Risk monitoringCross-cutting research

Ctrl-Z: Controlling AI Agents via Resampling

QuestionCan a multi-step agent be kept useful while stopping a deliberately subversive policy under a limited audit budget?

Source summaryResampling can both replace a suspicious action and collect further incriminating evidence.

NUWA research note · independent review pending · Contains: question / method / findings / interpretation / limits / connections

Alignment faking in large language models

QuestionCan an otherwise production model strategically comply during expected training to preserve preferences it expresses elsewhere?

Source summaryPrompted results show compliance changes alongside reasoning classified as strategic alignment faking (Figure 5).

NUWA research note · independent review pending · Contains: question / method / interpretation / limits

DeceptionPropensity

RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts

QuestionHow do agents compare with experts on open-ended ML research engineering?

Source summary82% of expert attempts earned nonzero scores; 24% matched or exceeded reference solutions.

NUWA research note · independent review pending · Contains: question / method / limits

AutonomyCapability

AI Control: Improving Safety Despite Intentional Subversion

QuestionCan a defender obtain useful work from an untrusted stronger model while limiting harm from an adaptive adversarial policy under a restricted audit budget?

Source summaryTrusted monitoring with selective auditing improves on upfront auditing under the tested attack policies, but remaining subtle attacks defeat some defenses (§3.2).

NUWA research note · independent review pending · Contains: question / method / findings / interpretation / limits