NUWA 
SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Tasks
QuestionCan security-agent datasets be built with reproducible vulnerability and patch checks?
Source summaryThe reported best success rates were 18.0% for PoC generation and 34.0% for patching on the complete dataset.
NUWA research note · independent review pending