I think the worst part is that some companies may be okay with it. They will pay attention only when it's messed up beyond repair. And it’s possible that fixing it will be a task for more advanced models, not humans. Do they win or lose at the end of this martingale? I am not sure
I blame the ML engineers who work on these recommendation systems. They chase simplistic objectives like CTR, time spent, and so on, which can be gamed by this kind of content. This creates huge positive feedback loops in which popular content becomes even more popular and forms “metas,” while models train on clickstream data they themselves have influenced. They could try to fix this, but they won’t, because no one is asking them to
That is a great question. IMO, major LLM players currently have a large enough user base to generate training data from their users (questions and user provided answers, corrections, etc). So, if StackOverflow dies, it will become harder to keep up with closed source models