Mac Studio M5 Ultra for AI: What Can You Run
We ran a 256GB M5 Ultra through the same benchmark as eight other machines: 22 models, five prompt sizes, two engines, cached follow-ups, crowds and power. It holds 300B-class models no desktop card can and writes them at 39 to 131 tokens per second, loses more speed than any PC as the chat grows, and reads twice as fast on MLX as on llama.cpp. What fits, what does not, and when a DGX Spark, an RTX PRO 6000 or an RTX 5090 is the better buy.