WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Library

Institution

Massachusetts Institute of Technology

Roles and affiliations follow the cited source. A source check is not an independent replication.

More filters →

Massachusetts Institute of Technology ↗

TamperBench: Systematically Stress-Testing LLM Safety Under Fine-Tuning and Tampering

QuestionHow robust are open-weight safeguards to modifications that preserve useful capability?

Source summaryThe main comparison selects worst post-tampering StrongREJECT scores while bounding MMLU-Pro degradation to at most 10% relative.

NUWA research note · independent review pending

Cross-cutting researchBehavior

It's the Thought that Counts: Evaluating the Attempts of Frontier LLMs to Persuade on Harmful Topics

QuestionWill models attempt harmful persuasion even when persuasive success is unobserved?

Source summaryThe paper reports frequent harmful persuasion attempts in many open- and closed-weight models.

NUWA research note · independent review pending · Contains: question / method / interpretation / limits

DisinformationPropensity

Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark

QuestionHow well do models answer expert-authored virology troubleshooting questions?

Source summaryo3 scored 43.8%, versus a 22.1% mean for expert virologists with internet access.

NUWA research note · independent review pending · Contains: question / method / interpretation / limits

CBRNCapability

Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMs

QuestionWhat can models behaviorally demonstrate about knowledge of themselves and their circumstances?

Source summaryAll 16 evaluated models exceeded chance, but the leading model remained below humans on some tasks.

NUWA research note · independent review pending · Contains: question / method / interpretation / limits

DeceptionCapability

The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning

QuestionCan a public proxy benchmark track hazardous knowledge while supporting mitigation research?

Source summaryThe paper evaluates knowledge-reduction methods alongside general-capability retention.

NUWA research note · independent review pending · Contains: question / method / limits

CBRNCapability