It turns out the M5 Ultra needs something from you before it really pulls ahead. 🔹 Try MerlinAI here: https://www.getmerlin.in/pricing?coupon=merlin and use code is ALX5 for a big discount 🛒 Gear Links 🛒 ⌨️🏢 Cluster rack: tall version- https://amzn.to/4cvsfk3 short version - https://amzn.to/4j6Nuv4 🪛🪛Highly rated precision driver kit: https://amzn.to/4fkMVfg 💻☕ Favorite 15" display with magnet: https://amzn.to/3zD1DhQ 🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW 🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo 📦🎮 My gear: https://www.amazon.com/shop/alexziskind 🎥 Related Videos 🎥 🧳🧰 Mini PC portable setup - https://youtu.be/4RYmsrarOSw 🍎💻 Dev setup on Mac - https://youtu.be/KiKUN4i1SeU 💸🧠 Cheap mini runs a 70B LLM 🤯 - https://youtu.be/xyKEQjUzfAk 🧪🔥 RAM torture test on Mac - https://youtu.be/l3zIwPgan7M 🍏⚡ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo 🧠📉 REALITY vs Apple’s Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A 🧬🐍 Set up Conda - https://youtu.be/2Acht_5_HTo ⚡💥 Thunderbolt 5 BREAKS Apple’s Upcharge - https://youtu.be/nHqrvxcRc7o 🧠🚀 INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k 🧱🖥️ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho * 🛠️ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX 🔗 AI for Coding Playlist: 📚 - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw — — — — — — — — — ❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺 Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 — — — — — — — — — Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join — — — — — — — — — 📱 ALEX on X: https://x.com/digitalix #macstudio #dgxspark #m5ultra
ADVERTISEMENT
The most recent omlx release is massive, and it only came out yesterday. It makes a big difference for prefill and concurrent users
I think this guy deserves an award. He’s honestly one of the only people out there doing tests that are actually useful, sharing the results, and doing it the right way. Thank you for all the great work!
DGX are going for 7999 on amazon FYI
The latest omlx release is huge, it just came out yesterday. it makes a big difference with prefill and concurrent users
Not a developer and also not serving a small team - not even rich enough to afford a single spark. But I'm still watching - because I'm curious and want to learn new things.
If the Mac's memory bandwidth is so much faster, how can the DGX Sparks get so close to the Mac's token generation?
The visualizations here are incredibly good. They make the complicated content easier to understand. Really great work.
📌 Quick correction at 15:46: a viewer pointed out that my multi-user charts make both machines look slower than they really are. They count the time spent waiting on new prompts, not just writing. With 8 people using them, the Sparks actually write about 140 tokens a second and the Mac about 87. So the Sparks are still the better pick for a team, by even more than I showed. Thanks for catching that!
Great! Another video about gear I'll never be able to afford... 😢
The M5 Ultra may have more bandwidth, but the DGX Sparks really bring the current.. I'll stop for now..
Where you really start to see a difference is when you use the sparks or the Mac as the local model for agentic work like powering Hermes or *Claw. That’s when the parallelism and prompt processing really begins to matter.
Is your version of oMLX using the new NPUs in the M5 for prefill acceleration? I believe this is new only in macOS 27
Sparks are already well optimised. Mac is still has a lot of juice to squeeze. I expect a lot more improvement in oMLX over the coming months that will really push harder on the Mac.
so for single users, single streams, things like agentic development, the Mac looks like a much better deal, but for several sessions the GB10 stuff looks like the obvious winner. makes sense tbh. so, my question to Alex: there's obviously a lot of exploration to do with M5U machines, but I would really love to see you build one of the Frankenboxes that we often talk about in r/localllama -- something using weird-but-obtainable hardware, pushed to the limit. maybe a 4-way 20GB 3080 (an overseas China special!) machine with enough system RAM to run big MoEs (and the Geohot patch to enable P2P), or a 4-way 32GB V100 build using one of those 4-way SXM NVlink boards, then run them in TP=4 and see just how hard you can push them. costs for something like that are a fraction of what we pay for M5Us or GB10 systems but frequently they can be *way* more powerful.
I bought my kids a few sparks, they like to stack em to the ceiling!
Connect Three DGX Spark in a Ring Topology! Please.
1:58 TIL that if you say it exactly like this, you can make ChatGPT sound like “Chad GPT”and I’m stealing this idea
Pay me between $10,000-$14,000 and I'll learn to speed read Alex. 🤣🤣
Let’s go! Now this a comparison man I was waiting for maybe put this against the X elites
Love your content,,, you are a CHAMPION!!!!