RunLocalAI
nvidia
GPU
32GB VRAM
enthusiast

NVIDIA GeForce RTX 5090

Blackwell flagship. 32GB GDDR7 on a 512-bit bus delivers ~1.79 TB/s memory bandwidth — the new top of consumer hardware for local LLM inference. Comfortably loads 70B Q4 with room for context.

Released 2025·~$2499 street·1792 GB/s memory bandwidth

Overview

Blackwell flagship. 32GB GDDR7 on a 512-bit bus delivers ~1.79 TB/s memory bandwidth — the new top of consumer hardware for local LLM inference. Comfortably loads 70B Q4 with room for context.

Where to buy
Geo-routed to your region. Approx. $2499.
Buy on Amazon↗

Some links above are affiliate links. We may earn a commission at no extra cost to you. How we make money.

Specs

VRAM32 GB
Power draw575 W
Released2025
MSRP$1999
Backends
CUDA
Vulkan

Models that fit

Open-weight models small enough to run on NVIDIA GeForce RTX 5090 with usable context.

Llama 3.1 8B Instruct
8B · llama
Qwen 3 8B
8B · qwen
Qwen 3 14B
14B · qwen
Llama 3.2 3B Instruct
3B · llama
Qwen 2.5 7B Instruct
7B · qwen
Phi-4 14B
14B · phi
DeepSeek R1 Distill Qwen 7B
7B · deepseek
Qwen 2.5 14B Instruct
14B · qwen
Compare alternatives

Hardware worth comparing

Same VRAM tier and the one step above and below — so you can frame the buying decision against real options.

Same VRAM tier
Cards in the same memory band
No verdicted peers yet in this VRAM band.
Step up
More VRAM — bigger models, more context
No verdicted hardware in the next tier up yet.

Frequently asked

What models can NVIDIA GeForce RTX 5090 run?

With 32GB VRAM, the NVIDIA GeForce RTX 5090 runs models up to ~32B in 4-bit, with room for context. See the model list below for tested combinations.

Does NVIDIA GeForce RTX 5090 support CUDA?

Yes — NVIDIA GeForce RTX 5090 is an NVIDIA card with full CUDA support, the most mature local-AI backend. llama.cpp, Ollama, vLLM, and ExLlamaV2 all run natively.

How much does NVIDIA GeForce RTX 5090 cost?

Current street price for NVIDIA GeForce RTX 5090 is around $2499 (MSRP $1999). Prices vary by region and supply.

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify hardware specifications.