WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Library

Risk Evaluation · Technical report

Insights into AI Agent Security from a Large-Scale Red-Teaming Competition | NIST

NUWA research note · independent review pending

First published: Source checked: 2026-10-25
NUWA Research NoteResearch questionDesign and assumptionsSource findingsNUWA interpretationLimits and contrary evidenceResearch and decision relevanceInstitutions and rolesOriginal resources

Model-assisted reading · Selected sections of the original full text or official article; a complete section-by-section audit remains pending.

At a glance

NUWA interpretation: adaptive human red teaming exposes shared instruction-boundary failures.

Research question

What does a public adversarial competition reveal about agent hijacking?

Design and assumptions

CAISI and partners analyze competition attacks and post-competition transfer across models and scenarios, rather than only fixed automated templates.

Source findings

Some attack families transferred across models and scenarios.

Attacks successful against more robust models tended to transfer to weaker models more than the reverse.

NUWA interpretation

NUWA interpretation: adaptive human red teaming exposes shared instruction-boundary failures.

Limits and contrary evidence

The official blog is a research summary, not a complete competition protocol or a deployment-frequency estimate.

Research and decision relevance

Model recommendation: use the competition as complementary evidence and recover the paper’s sampling and transfer denominators before quantification.

Precise source locations
  • Insights into AI Agent Security from a Large-Scale Red-Teaming Competition · BackgroundSelected original resource https://www.nist.gov/blogs/caisi-research-blog/insights-ai-agent-security-large-scale-red-teaming-competition; sha256:81546d5b664cf475535269d3dc95732d5ccaffa8730021a628898a74c8391abd; archived source capture; exact capture time not independently established
  • Insights into AI Agent Security from a Large-Scale Red-Teaming Competition · Key FindingsSelected original resource https://www.nist.gov/blogs/caisi-research-blog/insights-ai-agent-security-large-scale-red-teaming-competition; sha256:81546d5b664cf475535269d3dc95732d5ccaffa8730021a628898a74c8391abd; archived source capture; exact capture time not independently established
  • Insights into AI Agent Security from a Large-Scale Red-Teaming Competition · TakeawaysSelected original resource https://www.nist.gov/blogs/caisi-research-blog/insights-ai-agent-security-large-scale-red-teaming-competition; sha256:81546d5b664cf475535269d3dc95732d5ccaffa8730021a628898a74c8391abd; archived source capture; exact capture time not independently established

Source checking, extraction, editorial approval and replication are recorded separately. Methodology →

Institutions and roles

Cite and reuse

Cite the original publication for its findings. Cite this NUWA record separately for its explanation and retained snapshot.

Original publication · BibTeX
@misc{agent-security-red-teaming,
  title = {Insights into AI Agent Security from a Large-Scale Red-Teaming Competition | NIST},
  url = {https://www.nist.gov/blogs/caisi-research-blog/insights-ai-agent-security-large-scale-red-teaming-competition},
  year = {2026},
  date = {2026-03-23},
  version = {Source capture 2026-10-25},
  note = {Source capture 2026-10-25}
}
NUWA record · BibTeX
@misc{agent-security-red-teaming-nuwa,
  title = {Insights into AI Agent Security from a Large-Scale Red-Teaming Competition | NIST — NUWA research record},
  url = {https://whitzard.tech/en/nuwa/whitzard-index/work/agent-security-red-teaming/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--agent-security-red-teaming.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--agent-security-red-teaming.json.}
}

Evidence snapshot 2026-10-29.1 · Index updates · RSS

References

  1. [1] Insights into AI Agent Security from a Large-Scale Red-Teaming Competition. 2026-03-23 ; Official publication masthead and article byline; Background; Key Findings