Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs
Studies pretraining-data filtering as a safeguard against biothreat proxy knowledge and tests resistance to adversarial fine-tuning.
Verify byline in the original ↗