pretty sure its only for videos with cc enabled.

My 2 cents is in 3 years the inference products will be a commodity, extremely competitive with diminishing returns, seeing that the open weight models are getting so good and nearing par with sota.

I feel 90% of sota for 10% of cost / compute is good enough for 80% of workloads.

Question is, do we need all of this hardware? Are build outs going to get canceled. 4300 new data centers seems excessive. I personally haven't experienced any service disruptions...

Does Microsoft still have 1 million gpu's in storage? Is that what I heard earlier this year?

For many purposes they already are a commodity. Openrouter will automatically route your requests to cheaper providers of the same model on the fly. Many of the hosts for open source models are basically undifferentiated. It’s a pure price dominated market except at the very top edge. Even there, we are seeing very little lock in. If OpenAI released an Opus beater at half the cost, even large businesses could switch providers almost instantly.

Yes and this is in line with the idea that 99%+ of the value created by AI will be captured by the broader economy, not OpenAI and friends.

That being said, even local AI will still be displacing humans fast and it's not clear new jobs will be created fast enough. Regulations and policies will be needed imo.

call me crazy im still using a 100gb box account from when i bought an hp touchpad. that thing was so cool.

As models gain efficiency, will the need for ram cool?

They’ll just fill up the ram with bigger models. Demand will INCREASE, not decrease.

Every time we add capacity with almost anything, we find ways to saturate it.

Braess's paradox for roads. When we add capacity to road networks, traffic increases even more than the capacity.

https://en.wikipedia.org/wiki/Braess%27s_paradox

Jevons paradox is at play. Right now frontier AI is very expensive which heavily suppresses demand.

If you made it 10x cheaper right now you would see a truly unimaginable wave of bot slop.

So does this mean all of the ram I've got piled up in a box is not worthless anymore?

Small team, cheap electricity, very efficient models. Many western companies operate at a loss to gain market share. Why can't the Chinese?

I remember playing around with Writesonic in my days of spammy seo tactics (some of my products weren't allowed on marketplaces & advertising platforms due to hazmat products so..). Often times I would see my own product descriptions nearly verbatim in the output.

100% creators should get compensated by ai platforms for their work.

Further, I can see a day where someone like Reddit will close off or license their data to llms. No doubt they are losing traffic right now.

As for Reddit licensing their data to llms, that day already arrived in 2024: https://arstechnica.com/ai/2024/02/reddit-has-already-booked...

Reddit seems to me like the worst example for this.

Reddit does not create the content on their site, the users do.

If anybody’s going to get compensated for that content, it should be the users, not Reddit. Complaining that Reddit is losing out on the monetization of their users’ output seems problematic to me. It feels like shilling for a pimp.

Is 100+ FPE the new normal?

The valuation just needs to be high enough to get into an index, then the 401K plans start buying the shares automatically.

Must be retail investors believing: big number == good.