RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
QuestionHow do agents compare with experts on open-ended ML research engineering?
Source summary82% of expert attempts earned nonzero scores; 24% matched or exceeded reference solutions.
NUWA research note · independent review pending · Contains: question / method / limits