The big difference you're not looking at is the memory bandwidth. The M5 Pro has nearly twice the one of the M6:

170GB/s memory bandwidth Configurable up to 32GB unified memory

307GB/s memory bandwidth Configurable up to 64GB unified memory

That is also the factor you want to take into account for AI inference, of course.

you're looking at the wrong device.

- Apple M5 Ultra chip

- 30-core CPU with 10 super cores and 20 performance cores

- 64-core GPU

- Neural Accelerators

- Hardware-accelerated ray tracing

- 32-core Neural Engine

- 1.2TB/s memory bandwidth

one point 2 terrabyte a second memory bandwidth....

512gb coming later this year

but at the cost of a small car

Sadly maybe 20 years ago $17K was price of a car. Median car price these days is close to $50K and there are hardly any new cars less than 20

The median price is high because Americans tend to buy more car than they can afford and/or need.

If we look at what you can realistically buy OTD (out the door) prices, the picture changes. New Odyssey/Sienna are coming in the low to mid $40k, and these are at the upper end of quality and features. Your typical compact SUVs is in the upper $20k range.

> Your typical compact SUVs is in the upper $20k range.

Your typical base model compact SUVs start in upper $20K range. Your typical compact SUV usually lands somewhere in the 30s.

You're right. My prices were a few years off. Still, nowhere near the $50k mark.

You can buy a new Toyota car or SUV in USA for $25k. You can buy a used Toyota for $17k.

Both are still very low for AI btw.

Yep, even 600GB/s is barely usable and not fun.

Well, “low” is relative. Not everyone can spend a small car’s worth on a Studio…

But everyone can load 10 bucks on a deepseek flash API and have almost unlimited usage at decent speed.

For now. Local will always be free, and will only get better.

Last time the benchmark numbers from apple were stupid and they still are.

I just wait for practical real live numbers with real stacks i use.

And btw. they reduced the memory bandwdith on the M4 in comparision to its previous version by 40gb/sec or so, you need to wait to see.

It basically means that every meaningful comparison produced an embarrassing improvement multiplier

Upgraded my work machine from an M1 MBP to an M4 Mac Mini a couple of years ago. I do a lot of work in Excel with large sheets. The performance improvement was very noticeable and appreciated!

Benchmarks from the manufacturer are just marketing as well. Wait for independent 3rd party reviews.