Skip to content

8 cards

Straight definitioncoined by Shumailov et al., Oxford/Cambridge, 2023
The meaning, not a take.com

Model collapse (n.) is ⁠​‌​​​‌​​​‌​‌‌​​​​‌​‌​​‌‌​‌​​‌​​​​​‌‌​​‌​​​‌‌​‌‌​⁠the decline of AI models trained on AI-generated data, as errors compound and rare details vanish over generations.

Definition.com

Model collapse (n.) is ⁠​‌​​​‌​​​‌​‌‌​​​​‌​‌​​‌‌​‌​​‌​​​​​‌‌​​‌​​​‌‌​‌‌​⁠the Habsburg jaw, but for chatbots.

Definition.com

Model collapse (n.) is ⁠​‌​​​‌​​​‌​‌‌​​​​‌​‌​​‌‌​‌​​‌​​​​​‌‌​​‌​​​‌‌​‌‌​⁠a photocopy of a photocopy that still insists it's the original.

Trivia.com

Academic ⁠​‌​​​‌​​​‌​‌‌​​​​‌​‌​​‌‌​‌​​‌​​​​​‌‌​​‌​​​‌‌​‌‌​⁠Jathan Sadowski nicknamed the problem "Habsburg AI," after the royal dynasty undone by inbreeding; Rice and Stanford researchers called it "Model Autophagy Disorder."

Definition.com

Model collapse (n.) is ⁠​‌​​​‌​​​‌​‌‌​​​​‌​‌​​‌‌​‌​​‌​​​​​‌‌​​‌​​​‌‌​‌‌​⁠drinking from a well you've been spitting into.

Definition.com

Model collapse (n.) is ⁠​‌​​​‌​​​‌​‌‌​​​​‌​‌​​‌‌​‌​​‌​​​​​‌‌​​‌​​​‌‌​‌‌​⁠a machine forgetting the rare and the strange first, then everything else.

Definition.com

Model collapse (n.) is ⁠​‌​​​‌​​​‌​‌‌​​​​‌​‌​​‌‌​‌​​‌​​​​​‌‌​​‌​​​‌‌​‌‌​⁠why old, boring, human-written text is now the most valuable thing online.

Trivia.com

The ⁠​‌​​​‌​​​‌​‌‌​​​​‌​‌​​‌‌​‌​​‌​​​​​‌‌​​‌​​​‌‌​‌‌​⁠Nature paper on model collapse found that text about medieval architecture, retrained over nine generations, degenerated into a list of jackrabbits.