Articles tagged “rtx 5070 ti”

2 articles

Nov 10, 2026

The Best Graphics Card for Local AI, by Price per Token

We ran the same models on an RTX 5090, a Radeon AI PRO R9700, an RTX PRO 6000, a pair of RTX 5070 Tis, a 64GB mining card and three datacenter GPUs, then put every card on one chart against the price it sells for today. Memory decides what you can run, bandwidth decides how fast, and the fastest card is the worst deal.

gpulocal aillm

Oct 13, 2026

When the Model Doesn't Fit on the GPU

A 155GB model on a 96GB card still runs, if it is a mixture-of-experts model and llama.cpp parks the experts in system RAM. We measured fourteen such splits on an RTX 5090, a Radeon AI PRO R9700, an RTX PRO 6000, two RTX 5070 Tis and an H200: what the trick saves, what it costs, why the PC behind the card is what you are waiting on, how well a napkin predicts it, and the twelve-channel EPYC build that gets around it.

local aillmmixture of experts