NUWA 
Evaluating the Paperclip Maximizer: Are RL-Based Language Models More Likely to Pursue Instrumental Goals?
QuestionWhen do goal-directed model responses exhibit instrumental-goal behaviors?
Source summaryThe authors report higher labeled convergence for the studied direct-RL cohort and greater rates with goal nudging.
NUWA research note · independent review pending