Wednesday, July 23, 2025

AI model collapse is not what we paid for • The Register

As seen online:

“Welcome to Garbage In/Garbage Out (GIGO). Formally, in AI circles, this is known as AI model collapse. In an AI model collapse, AI systems, which are trained on their own outputs, gradually lose accuracy, diversity, and reliability. This occurs because errors compound across successive model generations, leading to distorted data distributions and "irreversible defects" in performance. The final result? A Nature 2024 paper stated, "The model becomes poisoned with its own projection of reality."”

— from AI model collapse is not what we paid for • The Register as of 23 July 2025