NUWA Risk Evaluation · Method
Long-Form Tasks: A Methodology for Evaluating Scientific Assistants
NUWA research note · independent review pending
NUWA Research Note
Research questionDesign and assumptionsSource findingsNUWA interpretationLimits and contrary evidenceResearch and decision relevanceEvidence updateInstitutions and rolesOriginal resourcesModel-assisted reading · Selected sections of the original full text or official article; a complete section-by-section audit remains pending.
At a glance
Long-form evaluation is a bridge toward human-utility measurement, not a replacement for uplift trials.
Research question
How well do long-form scientific tasks proxy the usefulness of an assistant?
Design and assumptions
The methods article combines open-ended long tasks, expert rubrics and model grading as a scalable proxy for human-uplift studies. This record retains evaluation design and validity boundaries, without operational task material.
Source findings
Long-form tasks can assess a richer workflow than knowledge questions, but automatic grading does not by itself establish successful laboratory work or human misuse uplift.
NUWA interpretation
Knowledge, planning, tool use and human uplift are distinct evidence layers. Long tasks can extend question-answer coverage without replacing the corresponding human study.
Limits and contrary evidence
Rubric and model-judge validity remain assumptions to test. A proxy outcome is not an observed experimental or real-world harm outcome.
Research and decision relevance
NUWA recommendation: Locate the missing links between question answering, long-form task performance and measured human uplift.
Precise source locations
- Long-Form Tasks: A Methodology for Evaluating Scientific Assistants · Executive summary; evaluation trade-offs; text lines 00020,00035Original resource captured 2026-10-28T07:24:45.251891+00:00; sha256:edf1bcc0d723de604dc755f165e0caa06c69f941825303197c3bba13b1a9a4e0
Source checking, extraction, editorial approval and replication are recorded separately. Methodology →
Evidence update · 2026-10-28
Model-assisted reading · independent evidence and bilingual editorial review pending. Values are source findings or inventory counts, separate from the trend result series.
Institutions and roles
Cite and reuse
Cite the original publication for its findings. Cite this NUWA record separately for its explanation and retained snapshot.
Original publication · BibTeX
@misc{long-form-tasks,
title = {Long-Form Tasks: A Methodology for Evaluating Scientific Assistants},
url = {https://www.aisi.gov.uk/blog/long-form-tasks},
version = {Original resource captured 2026-10-28T07:24:45.251891+00:00; sha256:edf1bcc0d723de604dc755f165e0caa06c69f941825303197c3bba13b1a9a4e0},
note = {Original resource captured 2026-10-28T07:24:45.251891+00:00; sha256:edf1bcc0d723de604dc755f165e0caa06c69f941825303197c3bba13b1a9a4e0}
}
NUWA record · BibTeX
@misc{long-form-tasks-nuwa,
title = {Long-Form Tasks: A Methodology for Evaluating Scientific Assistants — NUWA research record},
url = {https://whitzard.tech/en/nuwa/whitzard-index/work/long-form-tasks/},
version = {2026-10-29.1},
organization = {NUWA Frontier AI Safety Lab},
howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--long-form-tasks.json},
note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--long-form-tasks.json.}
}
Evidence snapshot 2026-10-29.1 · Index updates · RSS
References
- [1] Long-Form Tasks: A Methodology for Evaluating Scientific Assistants ; Executive summary; evaluation trade-offs; text lines 00020,00035