What hardware do you need to run DeepSeek-R1-Distill-Qwen-32B?
DeepSeek-R1-Distill-Qwen-32B at Q4_K_M is 20 GB of weights, with a context ceiling of 128k tokens. Thinks out loud at length, which eats your tokens/sec budget. Good at maths, poor at tool use.
How good is it, really?
On the Artificial Analysis Intelligence Index v4.3 it scores 8, which puts it in the Below every hosted tier band. Fine for simple, well-specified tasks. Noticeably less capable than anything the big labs sell today. Score source. See the whole table.
- Summarising — usable
- Translation — usable
- Everyday coding — usable
- Reasoning & maths — good
- Agentic work — don’t
What it costs either way
Renting the same model (or the nearest hosted equivalent, DeepSeek-R1-Distill-Llama-70B) costs $0.8 per million input tokens and $0.8 per million output (OpenRouter, cheapest active endpoint, checked 2026-09-03). Buying a machine only beats that if you use it hard enough, for long enough, that the hardware price divides down below the rental bill.
Machines that run it
| Machine | Price | Speed at 32k | Pay-back | |
|---|---|---|---|---|
| Strix Halo Framework Desktop, 64GB | $1,959 | 6.8 tok/s estimated | Pays back in 14 years | Run the numbers |
| Mac mini M5 Pro, 48GB | $2,299 | 8.1 tok/s estimated | Pays back in 17 years | Run the numbers |
| Mac Studio M5 Max, 48GB | $3,099 | 16 tok/s estimated | Pays back in 22 years | Run the numbers |
| MacBook Pro M5 Pro (16-inch), 48GB | $3,599 | 8.1 tok/s estimated | Pays back in 26 years | Run the numbers |
| DGX Spark GB10 Grace Blackwell, 128GB | $4,699 | 7.2 tok/s estimated | Pays back in 35 years | Run the numbers |
One machine per family, cheapest first. Speeds are measured where a public benchmark exists and estimated from memory bandwidth otherwise; the calculator says which for any configuration.
The specifics
- Parameters
- 32.8B
- Quantisation
- Q4_K_M
- Weights on disk
- 20 GB
- KV cache
- 8.6 GB at 32k context
- Maximum context
- 128k tokens (128k in config; the card does not state one for the distills)
- Licence
- MIT
- Sources
- source 1, source 2