nvidia
GPU
96GB VRAM
workstation
NVIDIA RTX PRO 6000 Blackwell
Pro Blackwell — 96GB GDDR7 ECC. The single-card answer to 70B and 100B+ local inference.
Released 2025·~$8999 street
Overview
Pro Blackwell — 96GB GDDR7 ECC. The single-card answer to 70B and 100B+ local inference.
Where to buy
Geo-routed to your region. Approx. $8999.
Some links above are affiliate links. We may earn a commission at no extra cost to you. How we make money.
Specs
| VRAM | 96 GB |
| Power draw | 600 W |
| Released | 2025 |
| MSRP | $8499 |
| Backends | CUDA Vulkan |
Models that fit
Open-weight models small enough to run on NVIDIA RTX PRO 6000 Blackwell with usable context.
Frequently asked
What models can NVIDIA RTX PRO 6000 Blackwell run?
With 96GB VRAM, the NVIDIA RTX PRO 6000 Blackwell runs 70B models in 4-bit quantization, plus everything smaller. See the model list below for tested combinations.
Does NVIDIA RTX PRO 6000 Blackwell support CUDA?
Yes — NVIDIA RTX PRO 6000 Blackwell is an NVIDIA card with full CUDA support, the most mature local-AI backend. llama.cpp, Ollama, vLLM, and ExLlamaV2 all run natively.
How much does NVIDIA RTX PRO 6000 Blackwell cost?
Current street price for NVIDIA RTX PRO 6000 Blackwell is around $8999 (MSRP $8499). Prices vary by region and supply.
Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify hardware specifications.