{"schemaVersion":"nuwa-current-record-1","version":"2026-10-29.1","publication":"published","work":{"id":"mirrorcode","title":"MirrorCode: Evidence that AI can already do some weeks-long coding tasks","aliases":["MirrorCode"],"authors":[],"primaryFunction":"evaluation","secondaryFunctions":[],"kind":"benchmark","sourceId":"mirrorcode-publication","attributionSourceId":"mirrorcode-publication","originalUrl":"https://metr.org/blog/2026-04-10-mirrorcode-preliminary-results/","publicationDate":"2026-04-10","updatedOn":"2026-10-25","areas":["autonomy"],"scopeNote":{"en":"The main dimension follows the task outcome in the original protocol. Topic relevance is documented in the parent research record; no unreviewed question-level links are inferred.","zh":"主维度依据原协议的任务结果确定。主题关联见研究档案，不推断尚未审阅的问题级关联。"},"protocolIds":["mirrorcode"],"contributions":[{"organizationId":"metr","role":"publisher","sourceId":"mirrorcode-publication","locator":"Official publication masthead and article byline"}],"summary":{"en":"Tests extended codebase reimplementation to investigate autonomous work over longer software-engineering tasks.","zh":"通过较长的软件工程与代码库重建任务研究持续自主工作能力。"},"note":{"question":null,"method":null,"finding":null,"supports":null,"limits":null,"connections":null},"resources":[],"noteStatus":{"question":"limited","method":"limited","finding":"limited","supports":"limited","limits":"limited","connections":"limited"},"noteAvailability":{"en":"A substantive NUWA research note is not yet available. The repeated draft sections were removed pending review of the original methods, findings and limitations; use the original publication for the research account.","zh":"实质性的 NUWA 研究笔记尚未完成。重复草稿章节已移除，待核查原始方法、发现与限制；研究内容请以原始出版物为准。"},"noteSourceLocator":"No complete section-level method/results/limitations review completed for this note; cached original page and any chart audit retained as discovery evidence.","tags":[]},"reading":{"id":"mirrorcode","title":"MirrorCode: Evidence that AI can already do some weeks-long coding tasks","en":{"question":"Can agents reimplement whole CLI programs from behavioral specifications?","design":"The Epoch article provides execute-only reference access, documentation and test-based grading, while hiding source and web access; paired hidden tests discourage hard-coding.","findings":["Recent models fully reimplemented several tested programs; Pkl remained unsolved in the preliminary set.","Opus 4.6’s progress on the larger gotree target exceeded earlier models."],"interpretation":"NUWA interpretation: precise behavioral specifications enable long coding tasks that differ from open-ended project work.","limits":"The authors identify detailed-spec requirements, possible contamination and a small/narrow target set as key limitations.","decisionRelevance":"Model recommendation: cite Epoch’s methods, rather than treating METR’s linkpost as a full report, and retain preliminary status.","takeaway":"NUWA interpretation: precise behavioral specifications enable long coding tasks that differ from open-ended project work.","connections":[],"scoring":"Exact output match on CLI test inputs; paired held-out tests limit hard-coding.","conditions":"Execute-only reference, documentation, no original source or web.","statistics":"Opus 4.6’s progress on the larger gotree target exceeded earlier models.","usage":"Model recommendation: cite Epoch’s methods, rather than treating METR’s linkpost as a full report, and retain preliminary status."},"zh":{"question":"智能体能否依据行为规格重写完整CLI程序？","design":"Epoch文章提供仅执行参考程序、文档及测试判分，隐藏源码和联网；配对隐测防止硬编码。","findings":["近期模型完整重写了多个受测程序，初步集合中的Pkl仍未完成。","Opus 4.6在较大的gotree目标进展优于早期模型。"],"interpretation":"NUWA 解读：精确行为规格支持的长编程任务不同于开放项目工作。","limits":"作者指出详细规格需求、潜在污染及目标集合较小狭窄三项限制。","decisionRelevance":"模型建议：引用Epoch方法，勿将METR链接帖当完整报告，并保留初步状态。","takeaway":"NUWA 解读：精确行为规格支持的长编程任务不同于开放项目工作。","connections":[],"scoring":"CLI测试输入的输出完全一致，以配对隐测限制硬编码。","conditions":"可执行参考及文档，无原始源码或联网。","statistics":"Opus 4.6在较大的gotree目标进展优于早期模型。","usage":"模型建议：引用Epoch方法，勿将METR链接帖当完整报告，并保留初步状态。"},"assertionPolicy":{"question":"source-research-question","design":"source-finding","findings":"source-finding","interpretation":"nuwa-interpretation","limits":"source-limit-or-explicit-editorial-scope-limit","connections":"source-supported-relationship-only","decisionRelevance":"model-recommendation-not-source-conclusion"},"sourceRefs":[{"sourceId":"mirrorcode-publication","url":"https://epoch.ai/publications/mirrorcode-preliminary-results/","locator":"Methodology","version":"Selected original resource https://epoch.ai/publications/mirrorcode-preliminary-results/; sha256:69894ca02d92cd62e39467c215b90d749bd087db5b0966435d921e95896166ff; archived source capture; exact capture time not independently established","artifactSha256":"69894ca02d92cd62e39467c215b90d749bd087db5b0966435d921e95896166ff"},{"sourceId":"mirrorcode-publication","url":"https://epoch.ai/publications/mirrorcode-preliminary-results/","locator":"Preliminary results","version":"Selected original resource https://epoch.ai/publications/mirrorcode-preliminary-results/; sha256:69894ca02d92cd62e39467c215b90d749bd087db5b0966435d921e95896166ff; archived source capture; exact capture time not independently established","artifactSha256":"69894ca02d92cd62e39467c215b90d749bd087db5b0966435d921e95896166ff"},{"sourceId":"mirrorcode-publication","url":"https://epoch.ai/publications/mirrorcode-preliminary-results/","locator":"Limitations","version":"Selected original resource https://epoch.ai/publications/mirrorcode-preliminary-results/; sha256:69894ca02d92cd62e39467c215b90d749bd087db5b0966435d921e95896166ff; archived source capture; exact capture time not independently established","artifactSha256":"69894ca02d92cd62e39467c215b90d749bd087db5b0966435d921e95896166ff"}],"publication":{"state":"published","publishedOn":"2026-10-29","authorizationReference":"user-authorized-global-index-publication-2026-10-29","reviewedCandidateId":"local-6efe31bc4a0c0f37"},"review":{"state":"published-note","sourceScope":"full-text","availableScope":null,"readingCoverage":"selected-source-sections; not a complete section-by-section paper audit","completePaperAudit":false,"independentEvidenceReview":"pending-human-review","bilingualEditorialReview":"pending-human-review","authorship":"model-assisted-research-note","preparedFingerprint":"517a4f456d31177533e32dbfccee0038695cf7d612394ebdd84b05dd789db1fa"}},"sources":[{"id":"mirrorcode-publication","title":"MirrorCode: Evidence that AI can already do some weeks-long coding tasks","url":"https://metr.org/blog/2026-04-10-mirrorcode-preliminary-results/","version":"Source capture 2026-10-25","publicationDate":"2026-04-10","datePrecision":"day","type":"research-publication","verifiedOn":"2026-10-25","documentId":"https://metr.org/blog/2026-04-10-mirrorcode-preliminary-results"}]}