Mac Studio With M5 Ultra Makes the Case for a Quiet Home LLM Box
Apple's refreshed Mac Studio offers up to 512GB of unified memory, a spec that matters more to local AI than almost anyt. Apple's refreshed Mac Studio offers up to 512GB of unified memory, a spec that matters more to local AI than almost anything else.
When people run large language models on their own hardware, memory is the wall they hit first. That is why Apple's latest Mac Studio is drawing attention well beyond video editors.
The machine now comes with M5 Max or M5 Ultra. The Ultra configuration reaches a 36-core CPU, up to an 80-core GPU, a 32-core Neural Engine and up to 512GB of unified memory with 1.2TB/s of bandwidth. The M5 Max version tops out at 128GB and 614GB/s.
Apple is leaning into the AI angle directly, citing running large language models locally among the target workloads and claiming up to 10.7 times faster AI performance for M5 Max than M1 Max, including faster time to first token in LM Studio.
Because the GPU and CPU share one memory pool, a large model can sit entirely in RAM without being split across graphics cards. Add Apple's famously quiet thermal design and the Mac Studio becomes a credible always-on home AI server, one that competes directly with NVIDIA's DGX Spark and the new wave of AMD Strix Halo mini PCs.
Image: apple.com.
InteliToys is editorial. We do not sell Apple Mac Studio With M5 Ultra Makes the Case for a Quiet Home LLM Box. Watch the source tape in the branded lightbox below, then argue about it in Gear Junkies.