What can each GPU run?
Pick your card to see every model in the index that fits it comfortably, at 4K context.
Best local LLMs by hardwareNVIDIA consumer
- RTX 509032GB · 90/112 fit comfortably
- RTX 508016GB · 64/112 fit comfortably
- RTX 5070 Ti16GB · 64/112 fit comfortably
- RTX 507012GB · 57/112 fit comfortably
- RTX 5060 Ti 16G16GB · 64/112 fit comfortably
- RTX 5060 Ti 8G8GB · 44/112 fit comfortably
- RTX 50608GB · 44/112 fit comfortably
- RTX 50508GB · 44/112 fit comfortably
- RTX 409024GB · 86/112 fit comfortably
- RTX 4080 Super16GB · 64/112 fit comfortably
- RTX 4070 Ti Super16GB · 64/112 fit comfortably
- RTX 4070 Ti12GB · 57/112 fit comfortably
- RTX 4070 Super12GB · 57/112 fit comfortably
- RTX 407012GB · 57/112 fit comfortably
- RTX 4060 Ti 16G16GB · 64/112 fit comfortably
- RTX 4060 Ti 8G8GB · 44/112 fit comfortably
- RTX 40608GB · 44/112 fit comfortably
- RTX 309024GB · 86/112 fit comfortably
- RTX 3080 Ti12GB · 57/112 fit comfortably
- RTX 3080 12G12GB · 57/112 fit comfortably
- RTX 3080 10G10GB · 57/112 fit comfortably
- RTX 3070 Ti8GB · 44/112 fit comfortably
- RTX 30708GB · 44/112 fit comfortably
- RTX 3060 12G12GB · 57/112 fit comfortably
NVIDIA DGX Spark (unified memory)
NVIDIA data centre
AMD Radeon
- Radeon RX 9070 XT16GB · 64/112 fit comfortably
- Radeon RX 907016GB · 64/112 fit comfortably
- Radeon RX 9060 XT 16G16GB · 64/112 fit comfortably
- Radeon RX 9060 XT 8G8GB · 44/112 fit comfortably
- Radeon RX 7900 XTX24GB · 86/112 fit comfortably
- Radeon RX 7900 XT20GB · 75/112 fit comfortably
- Radeon RX 7900 GRE16GB · 64/112 fit comfortably
- Radeon RX 7800 XT16GB · 64/112 fit comfortably
- Radeon RX 7700 XT12GB · 57/112 fit comfortably
- Radeon RX 7600 XT16GB · 60/112 fit comfortably
- Radeon RX 6900 XT16GB · 60/112 fit comfortably
- Radeon RX 6800 XT16GB · 60/112 fit comfortably
- Radeon RX 6700 XT12GB · 57/112 fit comfortably
- Radeon PRO W7900 48G48GB · 96/112 fit comfortably
- Radeon AI PRO R9700 32G32GB · 90/112 fit comfortably
- Instinct MI100 32G32GB · 88/112 fit comfortably
Intel Arc
Apple silicon
- Mac M5 Ultra 512G512GB · 107/112 fit comfortably
- Mac M5 Ultra 256G256GB · 103/112 fit comfortably
- Mac M5 Max 128G128GB · 102/112 fit comfortably
- Mac M5 Pro 64G64GB · 92/112 fit comfortably
- Mac M5 32G32GB · 83/112 fit comfortably
- Mac M4 Max 128G128GB · 102/112 fit comfortably
- Mac M4 Max 36G36GB · 88/112 fit comfortably
- Mac M4 Pro 48G48GB · 90/112 fit comfortably
- Mac M4 Pro 24G24GB · 67/112 fit comfortably
- Mac M3 Ultra 192G192GB · 103/112 fit comfortably
- Mac M3 Max 128G128GB · 102/112 fit comfortably
- Mac M3 Max 48G48GB · 90/112 fit comfortably
- Mac M3 Pro 36G36GB · 88/112 fit comfortably
- Mac M3 Pro 18G18GB · 58/112 fit comfortably
- Mac M3 16G16GB · 57/112 fit comfortably
- Mac M3 8G8GB · 25/112 fit comfortably
- Mac M4 24G24GB · 67/112 fit comfortably
- Mac M4 16G16GB · 57/112 fit comfortably
- Mac M2 16G16GB · 57/112 fit comfortably
- Mac M1 Max 64G64GB · 92/112 fit comfortably
- Mac M1 16G16GB · 57/112 fit comfortably
- Mac M1 8G8GB · 25/112 fit comfortably
- Mac M2 Ultra 192G192GB · 103/112 fit comfortably
- Mac M2 Max 96G96GB · 99/112 fit comfortably