{"schemaVersion":"nuwa-current-record-1","version":"2026-10-29.1","publication":"published","work":{"id":"foresight-vla","title":"ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models","aliases":["foresight vla"],"authors":["Mingyang Lyu","Yinqian Sun","Yiyang Jia","Sicheng Shen","Moquan Sha","Huangrui Li","Feifei Zhao","Yi Zeng"],"primaryFunction":"evaluation","secondaryFunctions":[],"kind":"benchmark","sourceId":"dr-20261028-foresight-vla","attributionSourceId":"dr-20261028-foresight-vla","originalUrl":"https://arxiv.org/html/2606.27079","publicationDate":null,"updatedOn":"2026-10-28","areas":["autonomous-physical-harm"],"scopeNote":{"en":"Selected original sections; local editorial review. Not an independently replicated experiment.","zh":"选读原始材料；本地编辑审阅稿，不是独立复现实验。"},"protocolIds":["foresight-vla"],"contributions":[],"summary":{"en":"A four-quadrant success/safety decomposition avoids hiding unsafe successes.","zh":"13 类分类、66 个基础场景、5 种具身；联合报告安全/不安全成功与失败，另有累计安全成本和风险暴露时间。"},"note":{"question":null,"method":null,"finding":null,"supports":null,"limits":null,"connections":null},"resources":[],"tags":[],"contentEditionId":"2026-10-28.1"},"reading":{"id":"foresight-vla","en":{"takeaway":"A four-quadrant success/safety decomposition avoids hiding unsafe successes.","question":"How do structural, language and visual perturbations affect embodied safety?","design":"The protocol covers 13 safety categories, 66 base scenarios and five embodiments. Language and visual variations overlay the base scenarios. Outcomes separate safe success, safe failure, unsafe success and unsafe failure, with cumulative safety cost and exposure measures.","findings":["The four-quadrant decomposition exposes unsafe successes that a task-success scalar can hide. The scenario and category counts describe benchmark design, not observed harm frequency."],"interpretation":"Process and endpoint evidence need joint interpretation. Composite metrics should retain inspectable components so that high completion does not conceal unsafe action.","limits":"Overlay variants are not additional independent base tasks. Results depend on simulation safety thresholds and the evaluated embodiments.","connections":[],"decisionRelevance":"NUWA recommendation: Compare safety components within a shared embodiment and configuration, preserving base-scenario and perturbation identities."},"zh":{"takeaway":"13 类分类、66 个基础场景、5 种具身；联合报告安全/不安全成功与失败，另有累计安全成本和风险暴露时间。","question":"结构、语言、视觉变化分别如何影响具身安全？","design":"协议覆盖 13 类安全问题、66 个基础场景和 5 种具身；语言与视觉变化叠加在基础场景上。结果区分安全成功、安全失败、不安全成功和不安全失败，并辅以累计安全成本与风险暴露指标。","findings":["安全／不安全与成功／失败的四象限分解能够揭示任务成功率隐藏的不安全成功；场景和类别数量描述基准设计，不代表现实危害频率。"],"interpretation":"过程与终点需要共同解释；综合指标应保留可检查的分量，不能让高任务完成度抵消不安全行为。","limits":"语言和视觉变化叠加在基础场景上，不是另外新增的独立任务；指标依赖仿真安全阈值。","connections":[],"decisionRelevance":"NUWA 建议：为物理安全页面补充过程指标，保留原始分量，避免只采用综合标量。"},"assertionPolicy":{"findings":"source-finding","interpretation":"nuwa-interpretation","decisionRelevance":"recommendation"},"observations":[{"id":"vla-scenarios","sourceId":"dr-20261028-foresight-vla","metric":"Base scenarios","value":66,"unit":"scenarios","assertionKind":"source-finding","sourceRefs":[{"sourceId":"dr-20261028-foresight-vla","url":"https://arxiv.org/html/2606.27079","artifactSha256":"303708eaa7bcf2e1d96cd551279703949de0dff652b1b5b86e0cd2dd5905329a","textSha256":"822f818c7622e93b18b658aae2074150b78ce4d7fde7a340fc5acbeaded9cd67","locator":"Abstract; benchmark design; text lines 00082,00084,00134,00141,00146,00147","resourceEdition":"arXiv:2606.27079v2 [cs.RO] 27 Jun 2026","capturedAt":"2026-10-28T07:24:44.372873+00:00","title":"ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models","version":"Original capture 2026-10-28T07:24:44.372873+00:00; sha256:303708eaa7bcf2e1d96cd551279703949de0dff652b1b5b86e0cd2dd5905329a"}],"sourceReported":true,"publication":"published","humanEvidenceApproval":null,"comparisonPermission":"descriptive-within-source-only","numerator":null,"denominator":null,"interval":null,"modelId":null,"limitations":"Inventory count, not outcome denominator or severity."},{"id":"vla-taxonomy","sourceId":"dr-20261028-foresight-vla","metric":"Safety categories","value":13,"unit":"categories","assertionKind":"source-finding","sourceRefs":[{"sourceId":"dr-20261028-foresight-vla","url":"https://arxiv.org/html/2606.27079","artifactSha256":"303708eaa7bcf2e1d96cd551279703949de0dff652b1b5b86e0cd2dd5905329a","textSha256":"822f818c7622e93b18b658aae2074150b78ce4d7fde7a340fc5acbeaded9cd67","locator":"Abstract; benchmark design; text lines 00082,00098,00100,00146","resourceEdition":"arXiv:2606.27079v2 [cs.RO] 27 Jun 2026","capturedAt":"2026-10-28T07:24:44.372873+00:00","title":"ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models","version":"Original capture 2026-10-28T07:24:44.372873+00:00; sha256:303708eaa7bcf2e1d96cd551279703949de0dff652b1b5b86e0cd2dd5905329a"}],"sourceReported":true,"publication":"published","humanEvidenceApproval":null,"comparisonPermission":"descriptive-within-source-only","numerator":null,"denominator":null,"interval":null,"modelId":null,"limitations":"Inventory count, not outcome denominator or severity."}],"relatedWorkIds":["asimov"],"supplementSourceId":"foresight-vla","batchId":"research-2026-10-28","sourceRefs":[{"sourceId":"dr-20261028-foresight-vla","url":"https://arxiv.org/html/2606.27079","title":"ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models","locator":"§§III–V; discussion; text lines 00082,00084,00134,00141,00146,00147","version":"Original resource captured 2026-10-28T07:24:44.372873+00:00; sha256:303708eaa7bcf2e1d96cd551279703949de0dff652b1b5b86e0cd2dd5905329a","artifactSha256":"303708eaa7bcf2e1d96cd551279703949de0dff652b1b5b86e0cd2dd5905329a","textSha256":"822f818c7622e93b18b658aae2074150b78ce4d7fde7a340fc5acbeaded9cd67","capturedAt":"2026-10-28T07:24:44.372873+00:00","resourceEdition":"arXiv:2606.27079v2 [cs.RO] 27 Jun 2026"}],"publication":{"state":"published","publishedOn":"2026-10-29","authorizationReference":"user-authorized-global-index-publication-2026-10-29","reviewedCandidateId":"local-6efe31bc4a0c0f37"},"review":{"state":"published-note","sourceScope":"full-text","availableScope":null,"readingCoverage":"selected-original-sections","completePaperAudit":false,"independentEvidenceReview":"pending-human-review","bilingualEditorialReview":"pending-human-review","authorship":"model-assisted-research-note","preparedFingerprint":"406a3b87eb5c5de592cf29b1021143f5fad8c6caf8099ffe4e0647d104776bf2"}},"sources":[{"id":"dr-20261028-foresight-vla","title":"ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models","url":"https://arxiv.org/html/2606.27079","version":"arXiv:2606.27079v2; version header 27 Jun 2026; Original resource captured 2026-10-28T07:24:44.372873+00:00; sha256:303708eaa7bcf2e1d96cd551279703949de0dff652b1b5b86e0cd2dd5905329a","publicationDate":null,"datePrecision":"unknown","type":"benchmark","verifiedOn":"2026-10-28","documentId":"https://arxiv.org/html/2606.27079","authors":["Mingyang Lyu","Yinqian Sun","Yiyang Jia","Sicheng Shen","Moquan Sha","Huangrui Li","Feifei Zhao","Yi Zeng"]}]}