Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Yes, but training is the most expensive part of ML, for example GPT-3 is estimated to cost something like 1-4 million USD.

That entirely depends on how many inferences the model will perform during its lifecycle. You can find different estimates for the energy consumption of ChatGPT, but they range from something like 500-1000 MWh a day. Assuming an electricity price of $0.165 per kWh, that would put you at roughly $80,000 to a $160,000 a day.

Even at the lower end of $80,000 a day, you'll reach your $4 Million in just 50 days.



That's not a proportional comparison, n simultaneous users to 1 training. How many users across how many GPUs is that 80k?

With PNN you would have to multiply n by 1-4 million, training cost explodes.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: