What can you run with 12 GB of memory?
A model does not get the 12 GB. It gets 11 GB on the one machine here sold with 12 GB, because the card keeps a margin free. That holds 11 of the 39 current models at 32k of context, and the strongest of them is Gemma 4 12B.
Run the numbers on Gemma 4 12B at 12 GB
Jump to: The machines sold with 12 GB · Models that fit in 12 GB · What 16 GB adds over 12 GB · How much context 12 GB leaves room for · Does a 12 GB machine pay for itself?
The machines sold with 12 GB
One machine here comes with 12 GB, and the fourth column is what it holds at 32k of context: the number its own page prints. No machine on sale here comes with 12 GB any more.
| Machine | What a model gets | Price | Models it holds at 32k | Strongest of them | |
|---|---|---|---|---|---|
| GeForce RTX 3060, 12GBprevious | 11 GB | $329card only | 11 | Gemma 4 12B | Run the numbers |
List prices, and the memory each maker publishes. A machine marked previous is one that is no longer sold, priced at what it launched at. The GeForce RTX 3060, 12GB is priced as the card alone, so add the PC around it before comparing it with a complete computer. All seven cards here are ranked by what each one holds.
Models that fit in 12 GB
Every current model the one 12 GB machine here holds at 32k of context, strongest first. The third column is the whole job at once: the weights plus the cache for 32k of context. The fourth says how many of the machines at this size have room for it, which is the part a size on its own cannot tell you. Speeds are on the GeForce RTX 3060, 12GB, the machine this list is cut from, which is no longer sold; speed follows memory bandwidth rather than memory size, so another machine at 12 GB runs the same model at its own rate, and its page gives every one of them.
| Model | Parameters | Needs at 32k | Machines at 12 GB | Speed on the GeForce RTX 3060, 12GB | |
|---|---|---|---|---|---|
| Gemma 4 12BQ4_K_M | 12B | 8 GB | 1 of 1 | 38 tok/s estimated | Run the numbers |
| Qwen3.5 9BQ4_K_M | 9.7B | 6.8 GB | 1 of 1 | 45 tok/s estimated | Run the numbers |
| Qwen3.5 4BQ4_K_M | 4.7B | 3.8 GB | 1 of 1 | 80 tok/s estimated | Run the numbers |
| MiniCPM5 2BQ4_K_M | 2.5B | 3 GB | 1 of 1 | 103 tok/s estimated | Run the numbers |
| Granite 4.2 8BQ4_K_M | 8B | 10.7 GB | 1 of 1 | 29 tok/s estimated | Run the numbers |
| Ling 3.0 tinyQ4_K_M | 7.9B | 6.4 GB | 1 of 1 | 45 tok/s estimated | Run the numbers |
| Gemma 4 E4BQAT Q4_0 | 8B | 5.7 GB | 1 of 1 | 31 tok/s estimated | Run the numbers |
| LFM2.5 2.6BQ4_K_M | 2.7B | 2.2 GB | 1 of 1 | 139 tok/s estimated | Run the numbers |
| Ministral 3 8BQ4_K_M | 8.9B | 9.8 GB | 1 of 1 | 31 tok/s estimated | Run the numbers |
| Ornith 1.5 9BQ4_K_M | 9.7B | 6.9 GB | 1 of 1 | 45 tok/s estimated | Run the numbers |
| Spark-X2.5 4BQ4_K_M | 4.1B | 3.9 GB | 1 of 1 | 79 tok/s estimated | Run the numbers |
For scale, the calculator starts from 80 tok/s for a hosted API and times a local machine against it. 3 of the 11 above reach it, and the slowest is 29 tok/s.
Superseded models are left out of the count, because what a machine is worth buying for is what you would run on it today; the leaderboard ranks every model this site lists, older ones included. Where the cache figure comes from is one section of the memory guide.
What 16 GB adds over 12 GB
The machine here with 16 GB that hands a model the most of it is the GeForce RTX 4080, 16GB, at 15 GB, and it holds 13 of the 39. At 12 GB the most is 11 GB, on the GeForce RTX 3060, 12GB, holding 11. The step adds gpt-oss-20b and Ministral 3 14B. The strongest either way is Gemma 4 12B.
The cheapest machine at 16 GB is the Mac mini M6, 16GB at $899. The cheapest at 12 GB is the NVIDIA GeForce RTX 3060, 12GB at $329, card only. One of those two is a card and the other is a whole computer, so the gap between them is not the price of the step.
Both sides are read off the machine at each size that hands a model the most, so the comparison is the best case against the best case. The table above has every machine at 12 GB and what each of them holds.
How much context 12 GB leaves room for
The cache grows with the window you ask for, so the same machine holds fewer models the longer the context. Every machine at this size hands a model 11 GB, so one column covers all of them. A model is counted only where its own context ceiling reaches that far.
| Context | 11 GB to a modelGeForce RTX 3060, 12GB |
|---|---|
| 4k | 12 |
| 8k | 12 |
| 16k | 12 |
| 32k default | 11 |
| 64k | 9 |
| 128k | 8 |
Counted over the 39 current models, at the quantisation each is listed at and with the cache at 16 bits. The calculator has a switch for a smaller cache, which changes both what fits and how fast a long window runs.
Does a 12 GB machine pay for itself?
On the NVIDIA GeForce RTX 3060, 12GB at $329, card only, the cheapest machine at 12 GB with a published price, the model that pays it back soonest at 500k tokens a day is Ministral 3 8B, in 13 years. At 20M tokens a day, agents running most of the day, it is Ministral 3 8B in 4.0 months. The GeForce RTX 3060, 12GB is the previous generation, so that price is what it launched at.
The sum is the same everywhere on this site: what the same work costs to rent, less what the electricity costs to generate it, against the price of the machine. The best buys rank the quickest pay-back at every level of use, and what it costs a month puts the machine and the API bill in the same shape.
Every figure is at 32k of context unless the row says otherwise, with the cache at 16 bits and each model at the quantisation this site lists it at. Weights are the published file sizes on each model's page, and the cache is worked out from the architecture recorded there. What a model gets is the memory the GPU can address, which each machine's page explains. Speeds say whether anybody measured them; where they were not, they are worked out from memory bandwidth. To change the context, the quantisation or the price you would pay, open the calculator. For the sizes either side of this one, the memory guide has the ladder in full.