katie on Nostr: The other thing to note… models that generate data and then train themselves on ...

The other thing to note… models that generate data and then train themselves on that data that they generated, tend to get further and further away from meaningful content. If you had a model that wrote novels and eventually it’s training only on the models it wrote. They would start to all sound the same and converge. Part of why it is so compelling is that the data it is trained off of is created by a large number of humans with different perspectives and goals. You’d have to create a lot of individual models with niche goals and perspectives to sustainably let it just create indefinitely without new human content.