Interesting about OpenAI is that they can use old models to generate new training sets. For them it's cheap. Example of that would be the use of GPT-4 to generate sets tailored for training smaller or MoE models. Which is hard to do manually.

Really accelerating AI development, with humans in the loop for now.