> Apple has a huge advantage because they get to pay nothing for a superior compute infrastructure that comes with a better privacy and latency story.
Right now, AI is a pay-$B-to-play and you need the massive datacenter compute for training and skilled researchers to develop. Apple silicon is neat, but let's not pretend like they have any credible story to tell about AI, and their recent deal with OpenAI suggests that they've been forced to punt.
> As soon as they release something, it's going to be good, and it's going to be free, because it runs fast on consumer hardware and consumer electricity.
Apple recently released their first public LLM, OpenELM. The largest released model is OpenELM-3B. The Instruct version of this model scores a 24.8 on the MMLU benchmark, which is a pick-one-of-four multiple choice test.
Apple's biggest and best model somehow manages to get less than 25% on a 4 option multiple choice exam. For reference, MS released a similar size model Phi3-mini-4k which scored a 69 on that same exam.
Yes, Apple has some nice local hardware to run models, but they don't have the models. They don't have the models because they don't have the people and they don't have the compute.
Right now, AI is a pay-$B-to-play and you need the massive datacenter compute for training and skilled researchers to develop. Apple silicon is neat, but let's not pretend like they have any credible story to tell about AI, and their recent deal with OpenAI suggests that they've been forced to punt.
> As soon as they release something, it's going to be good, and it's going to be free, because it runs fast on consumer hardware and consumer electricity.
Apple recently released their first public LLM, OpenELM. The largest released model is OpenELM-3B. The Instruct version of this model scores a 24.8 on the MMLU benchmark, which is a pick-one-of-four multiple choice test.
Apple's biggest and best model somehow manages to get less than 25% on a 4 option multiple choice exam. For reference, MS released a similar size model Phi3-mini-4k which scored a 69 on that same exam.
Yes, Apple has some nice local hardware to run models, but they don't have the models. They don't have the models because they don't have the people and they don't have the compute.