I’m looking forward to compile time perf which looks really good, and it’s really nice to have an article that doesn’t just look at the “amazing” video performance.
I’m kind of sick of video encode/decode perf comparisons though as it is invariably just software vs hardware, and unsurprisingly hardware is vastly faster.
"time sh ./build2-install-0.13.0.sh --local --yes ~/install
163s"
"As the first point of reference, let's compare it to my workstation with an 8-core Intel Xeon E-2288G (essentially i9-9900K plus ECC). It does the same build using vanilla Clang in 131s. While E-2288 is faster, M1's performance is nevertheless impressive. Especially when you consider that during the build the workstation is belching hot air and screaming like an airplane about to take off while M1 is whisper-quiet with barely warm air coming from its exhaust."
It seems that in the comparable power envelope M1 remains better:
Well, the next question is: is clang doing anything different for arm than for x86? Why is the difference so big if that is not the case? Memory, cache and latency might be the big thing, and there is nothing saying that intel or AMD couldn't compete with that.
Right, and on the flipside significant effort has been invested in Clang performance when compiling for Intel CPUs. Much of that is likely to the benefit of all backends, but some of it surely is specific to Intel.
IMO this bit right here is worthy of highlighting again:
> Especially when you consider that during the build the workstation is belching hot air and screaming like an airplane about to take off while M1 is whisper-quiet with barely warm air coming from its exhaust.
I have never run a significant amount of compilation on any machine that didn't hit heat issues. So either the M1 is doing very well at managing heat, or Clang is doing incredibly poorly at exploiting the full system. In either case this makes the M1 look like something special.
Keep repeating the same thing again and again, and people eventually start believing it.
I don't believe Apple processors are "game changing" as the hype warrants or that AMD and Intel or DOOMED, because the comparison with AMD and Intel CPU itself is flawed. It's only game changing like the lightening connector of Apple - it was based on existing technology that Apple was bold enough to customise and innovate for its specific needs. Their current processor is the same.
People are forgetting that this is not the first time that different CPU architectures are competing with one other! Apple themselves are historical proof of this with the many switches they have made over the last 3+ decade.
Apple has made a system-on-chip that is obviously quite different from the current Intel or AMD processors. Moreover their software is finely optimized for it. Kudos to them for doing so - they certainly have been bolder in pushing for these obvious existing innovations that no one was willing to spend some money to do so.
While Intel and AMD also offer integrated GPU with some of their CPU, they are nothing like the current spread of ARM SoCs that offer many other units integrated with the CPU - as this article itself points out, Apple's SoC contains a GPU, an image processing unit, a digital signal processing unit, Neural processing unit, video encoder / decoder, a "secure enclave" for encryption / decryption and unified memory (RAM integrated). (Note that this is not a unique innovation as claimed by this article, and some others - many ARM SoCs like these already exist in different variations. In fact, it's what made ARM popular.)
Obviously, when a system software or application uses these specific units of an SoC to process specific data, they may be faster than a processor that doesn't have these units. And Intel and AMD processors currently don't have these specific units integrated with their CPU. That is why comparing the Apple SoCs with Intel or AMDs processors and calling them "better" is bullshit to begin with as they aren't the same thing. If Intel and AMD also had these units along with RAM integrated within it, than it would be a reasonably fair comparison. (Assuming all the other hardware and software remain the same, which is quite difficult to do so with Apple computers as they make custom hardware that doesn't easily accept other parts.)
Yes, Apple system-on-chips for its desktop PC do appear to give a comparable performance to the current Intel and AMD CPUs (and even surpass it in some specific computing) through macOS. But calling it an AMD or Intel killer however is just illogical and exaggerated marketing - there is nothing that prevents either AMD or Intel to innovate even beyond what Apple has done, and integrate the RAM or build similar SoCs, if the market demands it.
I am betting that while Apple will certainly increase their profits and customer base with their own chips, they will also lose many "insignificant" customers like me who have no interest in buying an even less customisable and more closed system from Apple. Intel and AMD CPUs offer me more computing freedom than an Apple Silicon ever will.
I agree that people attribute too much magic to M1. I cringed when the speed advantage was attributed to faster atomic refcounts.
However, don't underestimate Apple's ability to take incremental improvements and make great products out of them:
> No wireless. Less space than a Nomad. Lame.
MacBook Air has a desirable form factor, 2-day battery life, reasonable price, and is actually powerful enough to stream and edit video, play some games, and doesn't sound like a helicopter while doing it.
This is a major breakthrough right now. You literally can't get any other laptop that is fanless, and has this price, battery life, and performance. It used to be a "choose two" situation.
Apple has some great engineers, and do produce some great products. Completely agree. And with the new MacBook Air, I agree with everything you said except the battery life - the 2 day battery life is only true for "light" computing. Do any heavy computing, like compiling on Xcode, and the battery life comes down drastically, and may be nearly comparable to other Intel / AMD laptop (ARM processors do beat x86 processors in power consumption).
That said, I do completely agree with you that the new Apple processors with its associated products will increase Apple's profit and even its consumer base. So much that the loss of "insignificant" consumers like me, who care more about computing freedom and avoiding closed systems won't really matter to them. Apple's target consumers are no longer the tech savvy.
there is nothing that prevents either AMD or Intel to innovate even beyond what Apple has done, and integrate the RAM or build similar SoCs, if the market demands it.
Actually I do wonder if they have a real issue here. Can the chip makers (AMD/Intel), the PC manufacturers (Lenovo/Dell/HP/etc) and Microsoft cooperate enough to compete.
I'm not sure Microsoft is that committed to Windows anymore (mobile first/cloud first). The PC manufacturers have been complacent for a long time, happy to suckle on the WinTel teat. Intel have been struggling to deliver (this is probably what drove Apple to switch).
Perhaps Microsoft could step up but my gut feeling is their heart isn't in it. What little moat Win32 still has disappears with a switch to ARM.
Yes, you've hit the bulls eye - Apple's M1 performs so well because both the software + hardware are optimised for each other. And that's the real challenge for AMD / Intel / Qualcomm / Nvidia etc. with their processors. ARM never took off for the desktop because it lacked good software support. Apple has fixed that within its ecosystem.
AMD is rumoured to be building a CPU that has both ARM and x86 cores - hope that is true as that will be truly game changing.
Microsoft has been trying to make Windows on ARM work for years now. It was a key drive behind "mobile first" efforts back when Microsoft worked hard on Windows Phone. It's been diminished since, but the effort hasn't disappeared. Most recently the Surface Pro X has been a return to Windows on ARM. The Surface Pro X is useful to mention for several reasons including things like Electron on M1 wouldn't have happened so fast if Microsoft hadn't put so much work into Chromium on ARM for Surface Pro X, and also that the Pro X was the first device to ship Microsoft's x86 (32-bit) emulation for traditional Win32 applications. (Microsoft also has in the beta pipeline x64 emulation for Windows on ARM.) Microsoft isn't necessarily in danger of losing their "moat" in any switch/focus to ARM at this point, given the wide variety of applications known to work out of the box on the Surface Pro X today (with more support/compatibility again already in the beta pipeline).
"Competing" in this sense is delivering similar user experience (battery life, performance, seamless hardware interactions) that Apple is achieving through their top-to-bottom control of the hardware and software.
It's not enough to show off Intel/AMD SoCs and call that good when the other components and software force subpar UX.
Again, they have already shown they can reduce battery usage with integrated GPU and video decoding. What's missing is unified memory, which is already in the pipeline for datacenter products: https://www.anandtech.com/show/15593/amd-unveils-cdna-gpu-ar...
As far as performance, MacOS has been slower than both Windows and Linux on the same hardware for as long as I can remember. I see no reason why both operating systems won't achieve better utilization of these upcoming systems than Apple does with their M1.
The M1 operates in a unique and valuable space right now, but the claim that it will be effectively impossible for the rest of the industry to move into that space doesn't hold water.
These are the exact same arguments folks made and probably still make with the original iPhone release. A decade later, Apple is one of the most valuable companies, no one profits from mobile business more than they do and their phones are clearly the best premium phones (the majority of its competition is from the budget category).
The way it's similar is that you yourself make a clear case in the number of ways apple's new silicon is actually groundbreaking but then you really are trying to concoct it in a way to find a flaw. The only real problem that you point out here, which also exists with the iPhone, is the anticompetitive and customisable nature of the future Apple is creating. Someone taking a stand on that in principle is commendable though questionable practically. Ignoring that for a moment, it is not really up to argument except by biased "old timers" that this is truly amazing work in chip and software design. It's not like no one else wants or cares about any of these metrics, it's that no one has been able to get their sh*t together in a way that Apple has.
Which is interesting because just a few years back MacBooks became a very bad choice for anyone for a number of hardware issues (outrageous keyboard, finicky motherboards, etc). So this is a very interesting 180 indeed.
> I've been seeing these articles for years. Oh no, Apple has made AirPods, who will buy anyone else's wireless earbuds now?. Oh no,Apple has created iPadOS, who will buy a PC laptop now?. Oh no, Apple made the trash can Mac with AMD "server" cards for so cheap, who will buy a PC workstation now?. Oh no, Apple made the iPad, who will buy a normal laptop now?. Oh no, Apple has made the iPhone, who will buy any other smartphone now?.
And that's the point you are missing.
Nobody denies that the Apple processor is a technological innovation. But like the iPhone, it is definitely an innovation limited to the APPLE ECOSYSTEM.
The new Apple processor will definitely make them more profit as it will attract more consumers. But it will neither kill Qualcomm or Nvidia or Intel or AMD. And whether you like it or not, Intel and AMD processors biggest advantage is the softwares they can run on it. And that's a huge advantage over Apple Processor that can only run the highly controlled and closed macOS BigSur where an application Firewall isn't even allowed to block Apple apps because Apple doesn't want you to.
Partly true, except you forget the sad story of companies such as Nokia, or Creative labs, or HTC, or even Motorola, that barely exist if at all, after Apple decimated their business model. Already, the PC laptop market is getting pummeled on both sides by Macs and Chromebooks, this will only accelerate that - no one with full conscience can recommend a PC laptop to a regular user anymore - go with a cheap chromebook or get an air at $1000.
Furthermore, the biggest casualty here is probably going to be Intel: graviton and M1 clearly show ARM is the future, so someone on the PC side is going to step up and create the M1 competition. It's probably not going to be as good but comparable, but it'll go circles around x86 again. This will then accelerate the transformation of more and more software to ARM compatibility and intel will probably play a similar song to Nokia or IBM and play a sad slow tune of death while it's only customers would be lazy monoliths sticking to their old server architectures.
> no one with full conscience can recommend a PC laptop to a regular user anymore - go with a cheap chromebook or get an air at $1000.
Absolutely no. Nobody with a conscience should recommend closed systems with less and less options for us consumers. The biggest advantage that AMD and Intel have over ARM is the software support they have and that means more freedom and choice for us than any similar ARM system. I've said it before - I bought an Intel Mac only because it gave me the option to not be trapped in Apple's clutches. And I certainly won't buy an Apple computer anymore unless I know for sure that it doesn't restricting my computing freedom anymore. (But there is no indication to that as Big Sur shows, Apple has tightened its control on macOS by preventing application firewalls from blocking Apple apps - an indication of how it further moves to turn macOS to a closed system like the ios.)
And it is precisely for this reason that I don't see Intel or AMD dying out anytime soon.
> These are the exact same arguments folks made and probably still make with the original iPhone release.
So true. The iPhone was by far not the first smartphone but it appeared with optimal timing as it was possible to create something really polished while still having enough features. Also now low energy is a trend and having a fast laptop with passive cooling is just surreal.
The MacBooks seem inferior in many ways but if you compare just the fact sheets, they are just more close to what a mobile user needs. (Battery life, generally solid components, low weight, it just works - and if not you can go to the next Apple store)
Intel definitely went a few times in the wrong direction with Itanium and also all the CPU bugs (although ARM had them as well). But I'm sure they'll come up with something new if needed, this wouldn't be the first time
The secure enclave is not used for bulk encryption and decryption, it is capable of encrypting its own secrets, but does not actually affect the speed of any benchmarks. The CPU is used for bulk encryption and ARMv8 ISA has special AES instructions, same as Intel.
As for video encoder/decoder, Intel had QuickSync for 10
years now. Nothing that is unique for Apple.
I assumed the secure enclave was an encryption / decryption processor. But isn't QuickSync part of the Intel GPU - I thought hardware video encoding and decoding were done by the GPU?
Secure enclave is more akin to the TPM. It stores some secrets even the OS can’t access, including your fingerprint/face biometric.
QuickSync is a dedicated hardware on the SoC die, not part of the GPU, but even if it were, it is just semantics if it is still on the same die.
>>> Moreover their software is finely optimized for it.
What's been impressive is that emulated code optimized for x86 runs faster on the M1. If more developer mindshare focuses on ARM optimizations and specifically writing software for the M1, the performance gains likely will even be more significant. That said, these chips are designed for a single computer, which hasn't been much of a focus area for Intel/AMD the past few years.
A minor correction, Rosetta 2 is binary translation, not emulation. In most cases, after a one-time translation, it's running as a native ARM executable, with less runtime overhead than emulation.
It'd be interesting to know how close the code quality is to what you'd get from generating ARM code from the compiler. The jump from compiling to the M1 may not be too big if the translation is good.
Another question is whether it's equally able to take advantage of the specialized execution units. It'd be interesting to know whether the native M1 compiler can target those units directly or if they're mostly used by Apple's libraries. I'd bet on the latter, although since there's no overhead of transferring data to the GPU, I wonder if there's any opportunity there to expand usage there.
It's very impressive and I don't know why having software optimized to the hardware is a demerit point. That /is/ part of the impressive part. The CPU and Rosetta2 are obviously designed to complement each other and the results speak for themselves on day one.
The fact that little more than a recompile is needed to make native binaries (obviously lots of exceptions to that) is also impressive and a testament to the work done until now on iOS/iPhone/iPad ecosystem. Of course, some minor complaints that old 32-bit apps don't work, even on intel systems.
Meanwhile we're on year 8 of false starts for Windows on ARM. In contrast to apple, a 10 year old 32-bit x86 app might work, but a recent app probably won't.
> It's very impressive and I don't know why having software optimized to the hardware is a demerit point.
It definitely isn't! The point was that we should consider both software + hardware together when praising the performance of the M1. That is why comparing the M1 with an Intel / AMD processor is like comparing Apples to Oranges. :)
So a new state of the art CPU is a bit faster than a 5 year old design that Intel kept milking without any significant changes? I think that sounds reassuring that there are companies still capable of innovation although I am not a fan of Apple, I admire them for getting Intel on their toes. Finally.
What about XBox and Playstation?
I gather AMD makes equivalent integrated silicon for the leading game systems, so that might be the most interesting comparison.