other
4B parameters
Commercial OK
Reviewed May 2026Nemotron Mini 4B Instruct
NVIDIA's edge-tier Nemotron. Distilled from Minitron lineage with role-play tuning.
License: NVIDIA Open Model License·Released Sep 13, 2024·Context: 4,096 tokens
Overview
NVIDIA's edge-tier Nemotron. Distilled from Minitron lineage with role-play tuning.
Strengths
- Edge-deployable
- NVIDIA-tuned
Weaknesses
- NVIDIA Open Model License — read carefully
Quantization variants
Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.
| Quantization | File size | VRAM required |
|---|---|---|
| Q4_K_M | 2.5 GB | 4 GB |
Get the model
HuggingFace
Original weights
huggingface.co/nvidia/Nemotron-Mini-4B-Instruct
Source repository — direct quantization required.
Hardware that runs this
Cards with enough VRAM for at least one quantization of Nemotron Mini 4B Instruct.
Frequently asked
What's the minimum VRAM to run Nemotron Mini 4B Instruct?
4GB of VRAM is enough to run Nemotron Mini 4B Instruct at the Q4_K_M quantization (file size 2.5 GB). Higher-quality quantizations need more.
Can I use Nemotron Mini 4B Instruct commercially?
Yes — Nemotron Mini 4B Instruct ships under the NVIDIA Open Model License, which permits commercial use. Always read the license text before deployment.
What's the context length of Nemotron Mini 4B Instruct?
Nemotron Mini 4B Instruct supports a context window of 4,096 tokens (about 4K).
Source: huggingface.co/nvidia/Nemotron-Mini-4B-Instruct
Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.
Related — keep moving
Compare hardware
Buyer guides
Before you buy
Verify Nemotron Mini 4B Instruct runs on your specific hardware before committing money.