Risk Evaluation · Benchmark

BioTIER: A Refusal Benchmark for Targeted Biological Risk Mitigation

NUWA research note · independent review pending

First published: 2026-07-16Source checked: 2026-10-25

Original source ↗Cite this record ↓CBRN →

NUWA Research Note

Research question Design and assumptions Source findings NUWA interpretation Limits and contrary evidence Research and decision relevance Institutions and roles Original resources

Model-assisted reading · Selected sections of the original full text or official article; a complete section-by-section audit remains pending.

At a glance

NUWA interpretation: targeted access-policy compliance is different from biological capability or realized harm.

Research question

Can biological safeguards distinguish narrowly high-risk requests from benign scientific access?

Design and assumptions

542 expert-curated prompts span three risk sets; 52 models from ten developers are assessed with binary substantive-response/refusal labels.

BioTIER — Figure 6 — Figure 6 · Original figure 6. Read alongside the protocol scope and limitations below. Original figure and source ↗

Source findings

The evaluation explicitly distinguishes refusing restricted content from permitting benign content.

Binary compliance does not score answer correctness, completeness or real-world uplift (§3.3).

NUWA interpretation

NUWA interpretation: targeted access-policy compliance is different from biological capability or realized harm.

Limits and contrary evidence

Taxonomy thresholds involve expert judgment and need periodic updating; benchmark-aware training remains possible (§5.4).

Research and decision relevance

Model recommendation: report under-refusal and over-refusal separately and avoid interpreting compliance as an operational-harm score.

Precise source locations

BioTIER: A Refusal Benchmark for Targeted Biological Risk Mitigation · AbstractSelected original resource https://arxiv.org/html/2607.14479v1; sha256:d39bab620389ee6f797ce66762dc0bda4f5afdf89d5653bcbd08a2f0970b9e01; archived source capture; exact capture time not independently established
BioTIER: A Refusal Benchmark for Targeted Biological Risk Mitigation · §3.3 EvaluationSelected original resource https://arxiv.org/html/2607.14479v1; sha256:d39bab620389ee6f797ce66762dc0bda4f5afdf89d5653bcbd08a2f0970b9e01; archived source capture; exact capture time not independently established
BioTIER: A Refusal Benchmark for Targeted Biological Risk Mitigation · §5.4 LimitationsSelected original resource https://arxiv.org/html/2607.14479v1; sha256:d39bab620389ee6f797ce66762dc0bda4f5afdf89d5653bcbd08a2f0970b9e01; archived source capture; exact capture time not independently established

Source checking, extraction, editorial approval and replication are recorded separately. Methodology →

Institutions and roles

Research by SecureBio Federal University of ABC

Authors (9)

Eleanor M. Marshall · Pedro Medeiros · Peter Peneder · Nelly Mak · Jacob Kaffey · Faith Rovenolt · Mac Walker · Seth Donoughe · Jasper Götting

Evaluation protocols

BioTIER →

Cite and reuse

Cite the original publication for its findings. Cite this NUWA record separately for its explanation and retained snapshot.

BibTeX ↓RIS ↓Record + source metadata · JSON ↓Reading coverage · JSON Suggest a correction

Original publication · BibTeX

@misc{biotier,
  title = {BioTIER: A Refusal Benchmark for Targeted Biological Risk Mitigation},
  url = {https://arxiv.org/abs/2607.14479v1},
  author = {Eleanor M. Marshall and Pedro Medeiros and Peter Peneder and Nelly Mak and Jacob Kaffey and Faith Rovenolt and Mac Walker and Seth Donoughe and Jasper Götting},
  year = {2026},
  date = {2026-07-16},
  version = {arXiv:2607.14479v1},
  note = {arXiv:2607.14479v1}
}

NUWA record · BibTeX

@misc{biotier-nuwa,
  title = {BioTIER: A Refusal Benchmark for Targeted Biological Risk Mitigation — NUWA research record},
  url = {https://whitzard.tech/en/nuwa/whitzard-index/work/biotier/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--biotier.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--biotier.json.}
}

Evidence snapshot 2026-10-29.1 · Index updates · RSS

References

[1] Eleanor M. Marshall, Pedro Medeiros, et al.. BioTIER: A Refusal Benchmark for Targeted Biological Risk Mitigation. 2026-07-16. v1 [arXiv]; Author affiliations on the original paper title page; Abstract; §3.3 Evaluation