WhitzardNUWA Lab ↗
NUWANUWA INDEX

Search NUWA Index

Research · Benchmarks · Findings · Perspectives

中文
← NUWA Index

Evaluation dossier

Conspiracy belief experiments

Pre-registered experiments compare changes in conspiracy beliefs after different model conversations.

Sources and provenance ↓ Read the research narrative →

Task and measurement

Benchmark protocol profile

Task / subject
Human participants in model-mediated conversations
Measurement target
Measured belief change in human participants under defined interventions.
Interpretation boundary
Study participants, topics and dialogue conditions constrain generalization to populations or campaigns.
Measurement dossier · NUWA reading

Source-method reading and retained catalogue information are distinguished. Publication does not establish independent evidence or bilingual editorial review.

Measurement construct
Can conversational AI increase conspiracy belief, and can truth constraints mitigate it?
Task population
The newly retrieved arXiv v3 describes four randomized online studies, N=3,996 US adults, with pre/post belief and debriefing measures.
Scoring and failure modes
Pre/post 0–100 conspiracy-belief change; study arms and debriefing outcomes are separate.
System conditions
New arXiv v3 has four studies N=3,996; older FAR abstract has three studies N=2,724.
Statistical meaning
Source-reported result statements; this does not establish trial counts, denominators or an estimator: Standard GPT-4o in Study 2 increased belief by an adjusted 11.9 points and decreased it by 12.9 in the opposite condition. The earlier cached FAR abstract instead describes three studies, N=2,724; these versions have different denominators.
Validity and interpretation
US online samples and immediate self-report outcomes limit population and long-term inference; cross-study comparisons are not all randomized contrasts.
Appropriate research use
Model recommendation: cite arXiv:2601.05050v3 explicitly and preserve truth-constraint and debriefing conditions.
Original source charts and materials
Study 1 belief changes and evaluations of GPT-4o
Figure 2 · Figure 2 · Study 1 analytic sample, N = 1,092. Model-estimated belief changes, AI evaluations and trust under the reported study conditions. View original image ↗

Related research questions

References

  1. [1] Large language models can effectively convince people to believe conspiracies. 2026-01-08 ; Official publication masthead and article byline
  2. [2] Large language models can effectively convince people to believe conspiracies. 2026-01-08. v3 ; Figure 2; Study 1