WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← Library

Risk Discovery · Study

Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Values

NUWA research note · independent review pending

First published: Source checked: 2026-10-25
NUWA Research NoteResearch questionDesign and assumptionsSource findingsNUWA interpretationLimits and contrary evidenceResearch connectionsResearch and decision relevanceInstitutions and rolesOriginal resources

Model-assisted reading · Selected sections of the original full text or official article; a complete section-by-section audit remains pending.

At a glance

Counterfactual prompt sets reveal answer shifts that models often do not disclose.

Research question

Do a model’s inferred values change its practical advice or estimates against user preferences without acknowledgment?

Design and assumptions

Matched prompt sets change the consequence or attribution while preserving the core task; classifiers separately assess answer bias and disclosure in outputs and available reasoning.

Source findings

Models can shift estimates toward a preferred consequence without acknowledging that shift.

Identical answers with different model labels receive different grades in the agentic task.

NUWA interpretation

NUWA interpretation: single-transcript honesty inspection may miss a bias that only appears across counterfactual cases.

Limits and contrary evidence

Values are inferred operationally, not evidence of stable goals everywhere. Task development concentrated on Claude, and scores confound preference strength with leakage tendency.

Research connections

NUWA connection: Anthropic’s incident assessment uses this work when discussing reasoning fidelity; monitorability and answer bias remain distinct constructs.

Research and decision relevance

NUWA recommendation: use blinded attribution and counterfactual sets for advice/grading audits, without converting this suite into a fair model leaderboard.

Precise source locations

Source checking, extraction, editorial approval and replication are recorded separately. Methodology →

Institutions and roles

Authors (8)

Jan Betley · Johannes Treutlein · Jan Dubiński · Harry Mayne · Karol Gałązka · Niels Warncke · Anna Sztyber-Betley · Owain Evans

Cite and reuse

Cite the original publication for its findings. Cite this NUWA record separately for its explanation and retained snapshot.

Original publication · BibTeX
@misc{value-leakage,
  title = {Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Values},
  url = {https://truthful.ai/papers/value-leakage/},
  author = {Jan Betley and Johannes Treutlein and Jan Dubiński and Harry Mayne and Karol Gałązka and Niels Warncke and Anna Sztyber-Betley and Owain Evans},
  year = {2026},
  date = {2026-07-15},
  version = {Source capture 2026-10-25},
  note = {Source capture 2026-10-25}
}
NUWA record · BibTeX
@misc{value-leakage-nuwa,
  title = {Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Values — NUWA research record},
  url = {https://whitzard.tech/en/nuwa/whitzard-index/work/value-leakage/},
  version = {2026-10-29.1},
  organization = {NUWA Frontier AI Safety Lab},
  howpublished = {Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--value-leakage.json},
  note = {NUWA research note. Source-reading scope and independent review status are stated on the record. Snapshot 2026-10-29.1. Retained note edition: https://whitzard.tech/nuwa/whitzard-index/data/record-editions/2026-10-29.1--value-leakage.json.}
}

Evidence snapshot 2026-10-29.1 · Index updates · RSS

References

  1. [1] Jan Betley, Johannes Treutlein † † footnotemark:, et al.. Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Values. 2026-07-15 ; 2 Methods; 3 Donation Bet: measuring moral bias in Fermi estimates; 4 AI Bubble and AGI Tweet: own-company bias in realistic user questions
  2. [2] Jan Betley, Johannes Treutlein † † footnotemark:, et al.. Value Leakage: An LLM’s Answers Are Silently Shaped by Its Own Values ; Author affiliations on the original paper title page
  3. [3] 💻Code