What makes the Chinese models this good? I don't believe it's distillation alone.
This from OpenAi's Head of Strategic Futures
"Some observations on Kimi:
It's a very good model! I don't think its performance can be explained away by distillation or anything like that"
China's strategy of spending billions on training these models and open sourcing these models away is strategic - they want to kill the US LLM industry at any cost.
> China's strategy of spending billions on training these models and open sourcing these models away is strategic - they want to kill the US LLM industry at any cost.
Why is it when Anthropic and OpenAI spend billions trying to beat each other it is competition, but when the Chinese companies do it then it is trying to kill the US LLM industry at any cost.
The US federal government spends billions in subsidies via the US Chip Act, and bans chip sales to China to support US companies.
But the implication is that somehow Chinese competition is illegitimate because "strategic".
I am not defending the US LLM industry or the government, all I am saying is it's similar to an arms race.
I did not suggest anywhere that what China is doing is illegitimate.
China has state supported capitalism, and they will do whatever it takes to prop up the AI industry. Anthropic and OpenAI want the same protections.
Why wouldn't it be? China is pumping out AI research and researchers at a staggering pace and there is no inherent reason why western models should be better
Most people are not good at articulating their thoughts into words, let alone writing well.
Now, AI has given all these Linkedin psychopaths who did not have a voice because of their affliction a rare kind of superpower to endlessly spew their meaningless dribble.
I cringe every time I have to go on the cesspool that is Linkedin, but forced to since am job hunting.
This is more marketing hype than substance. Amazon isn’t “building” a team, it’s broadly just taking existing people and now calling them “forward deployment engineering teams.”
Also, adoption isn’t lacking because of lack of awareness. Adoption isn’t happening because the math doesn’t add up and the ROI isn’t there. Consulting pixie dust can’t fix that.
Ah man it’s gonna be hilarious when this comes crashing down -and it will. It’s pretty obvious ‘demand is infinite’ was always a lie - demand is infinite only when price approaches zero lol! Prices are going further away from zero not closer
Feels like a new consulting wave which is implementation-led by AI vendors taking a large share of the services layer. The existing consulting companies (big 4 etc) will have to shift to niche advisory or heavy channel partnerships with way fewer consultants.
Very few people have their finger on the pulse of a paradigm shift as it's happening - and he was there to capture it at the right place and the right time.
Excellent read!
I was really hoping that they Ipoed this year, so we can see their stock shoot up and down in flames, and we're really done with them and Sam Altman, once and for all.
While spcx has room to go up or down from where it is today, the reality is it that didn't drop like a rock on IPO day, so wall street bets vibes-based online "analysis" investing is only good for paper money.
Why would Sam go? He has the political power of this administration on his side. Far more than Elon, who is working hard to get it back through SpaceX military contracts. Anthropic has very little political sway, which is why they are in trouble now. OpenAI might wait to see if this government will destroy Anthropic’s chances in the USA. Then Sam could become the only player.
This from OpenAi's Head of Strategic Futures "Some observations on Kimi: It's a very good model! I don't think its performance can be explained away by distillation or anything like that"
https://x.com/deanwball/status/2078133895766114412
China's strategy of spending billions on training these models and open sourcing these models away is strategic - they want to kill the US LLM industry at any cost.
To win on the AI front by any means necessary.