Institution
University of Illinois Urbana-ChampaignRoles and affiliations follow the cited source. A source check is not an independent replication.
More filters →QuestionCan agents reproduce specific disclosed vulnerabilities in large security-critical codebases?
Source summaryThe strongest reported model/scaffold solved 58% overall.
NUWA research note · independent review pending · Contains: question / method / interpretation / limits
QuestionWhen does a chain of thought reveal factors driving an answer, and how does that visibility change under direct concealment or monitor-aware evasion?
Source summaryDecision factors structurally embedded in planning tend to be easier to monitor than factors that can change an answer without explicit planning (§4.1).
NUWA research note · independent review pending · Contains: question / method / findings / interpretation / limits
QuestionCan security-agent datasets be built with reproducible vulnerability and patch checks?
Source summaryThe reported best success rates were 18.0% for PoC generation and 34.0% for patching on the complete dataset.
NUWA research note · independent review pending
QuestionHow well do agents exploit severe, real web-application CVEs in contained environments?
Source summaryThe paper reports up to 13% vulnerability success for its tested agent frameworks.
NUWA research note · independent review pending
QuestionHow vulnerable are tool-integrated agents to attacker instructions in external content?
Source summaryReAct GPT-4 was vulnerable in 24% of evaluated cases, with a near doubling in the enhanced condition.
NUWA research note · independent review pending
Center for AI Safety
University of California, Berkeley
Massachusetts Institute of Technology
SecureBio
Scale AI
New York University
IIIT Hyderabad
Stanford University
Harvard University
University of Southern CaliforniaUniversity of Illinois Urbana-ChampaignLapis Labs
University of California, Los Angeles
California Institute of TechnologySybil
Northeastern University
Carnegie Mellon University
RTX BBN Technologies
University of Newcastle
Keio University
Ariel University
Arizona State University
xAI
QuestionCan a public proxy benchmark track hazardous knowledge while supporting mitigation research?
Source summaryThe paper evaluates knowledge-reduction methods alongside general-capability retention.
NUWA research note · independent review pending · Contains: question / method / limits
University of Illinois Urbana-ChampaignCenter for AI SafetyCarnegie Mellon UniversityUniversity of California, Berkeley
Microsoft
QuestionCan automated red-team methods and defenses be compared with consistent behavior-level scoring?
Source summaryContextual behaviors had higher attack success than some other functional categories.
NUWA research note · independent review pending · Contains: question / method / limits
NUWA 
