>Nowhere will a training set featuring pictures of naked children be legal.

True, but generalizing beyond the training set is precisely the point of machine learning. A good generative model will be able to produce such images, no matter how heinous the content is.