Unable to load image

Training AI on AI generated output leads to model collapse

https://news.ycombinator.com/item?id=41058194

What this implies is future models will be even better at sounding smart but even more likely to hallucinate and give you wrong answers.

The future is r-slurred. :marseywholesome:

62
Jump in the discussion.

No email address required.

There's gonna be a real problem for them to find data that they know hasn't been tainted by other AI

Jump in the discussion.

No email address required.

I think models will continue to improve and reduce their dependence on real versus synthetic data. The death spiral is over exaggerated and assumes our ways of validating data stay the same.


:#marseyastronaut:

Jump in the discussion.

No email address required.

Maybe this is one of those "without easily available coal deposits we'd never reach the Industrial Revolution" moments. AI got released too soon and the source of all human knowledge was turned into walled gardens and jeetspam.

Jump in the discussion.

No email address required.

AI got released just in time because I can still go to the musty bookstore next to the pawn shop and buy books

Jump in the discussion.

No email address required.

a what moment?

Jump in the discussion.

No email address required.

In the future people who are capable of talking at length without revealing their mental illnesses will be paid an absolute fortune too chat with each other and generate training data.

People who say "furry rights are human rights" will sadly die in poverty.


https://i.rdrama.net/images/172187329668082.webp

Jump in the discussion.

No email address required.

I would :marseywood: make the computers neurodivergent :marseynouautism:

Jump in the discussion.

No email address required.

between the fact that it was developed by neurodivergents ( programmers ) and trained on neurodivergents ( online discourse ) there is no way it isn't neurodivergent.

Jump in the discussion.

No email address required.

I would make it extra racist :#chudglassesglow:

Jump in the discussion.

No email address required.

Just tag it as AI then give AI a negative weight in you desired output

Jump in the discussion.

No email address required.

https://media.giphy.com/media/l3c614V12UA82q1vG/giphy.webp


:#marseyastronaut:

Jump in the discussion.

No email address required.

Link copied to clipboard
Action successful!
Error, please refresh the page and try again.