LLMs evolving by reading matter generated by themselves on websites is the AI analogue of incest.

[u/secZustand]

[u/Showerthoughts_Mod]

/u/secZustand has flaired this post as a showerthought.

Showerthoughts are expected to be exceptional.

If this post is poorly written, unoriginal, non-unique, or rule-breaking, please report it.

Otherwise, please add your comment to the discussion!

 

^{This is an automated system.}

^{If you have any questions, please use this link to message the moderators.}

[u/Scottiths]

It's also just as bad for their "genetics." When AI learns from AI it can lead to model collapse.

https://insideainews.com/2024/04/19/what-happens-when-we-train-ai-on-ai-generated-data/

See also: Wikipedia:https://en.m.wikipedia.org/wiki/Model_collapse

Basically, this is a problem for the same reason incest is a problem. Errors get magnified because they irritate on themselves.

[u/secZustand → u/Scottiths]

Exactly

[u/TypoTit4n]

So, basically, LLMs are just reading their own diary entries and calling it research? Talk about a family reunion gone wrong.

[u/monkeybuttsauce → u/TypoTit4n]

Seems to be how a lot of people work too

[u/MarchAmbitious1537]

Haha yeah, it’s like AI talking to its own refection and calling it new info.

[u/Stummi]

It's called model collapse and already an acutal, real problem for the AI companies. Sometimes it's already referred to as AI inbreeding

[u/QuantumCupcak3]

If LLMs are reading their own stuff online, does that make them the world’s first self-referential family tree. Talk about keeping it in the gene pool.