The costs are also largely being ignored at the moment. Both the obvious marginal costs (electricity, hardware for compute, dev time) and the hidden costs (flood of spam and misinformation).
I was really surprised to read the other day that Dell isn't making money on AI servers. I played around with the server build tool on their website and was surprised to see that a H100 adds ~$50K to a server! How the heck are these companies spending $100K per server going to get back their ROI? Are all these costs going to get written off as R&D? This really seems like the dot-com days but worse somehow.
