HCAST: Human-Calibrated Autonomy Software Tasks
QuestionCan human task duration ground autonomy capability measurement?
Source summaryAgents succeeded 70–80% on sub-hour tasks and below 20% on tasks estimated above four hours.
NUWA research note · independent review pending