What AI Can My Computer Run?
Pick your graphics card or Mac and see which local models fit in its memory, and how much context each one leaves room for.
- Model file
- Context
- Allowance
- Your GPU memory
Fits
39- Needs 20 GB 12 GB spareContext up to40,960
- Qwen2.5 32BAlibaba · Q4_K_M · downloadNeeds 20 GB 12 GB spareContext up to32,768
- DeepSeek-R1 Distill 32BDeepSeek · Q4_K_M · downloadNeeds 20 GB 12 GB spareContext up to52,730
- Qwen2.5 Coder 32BAlibaba · Q4_K_M · downloadNeeds 20 GB 12 GB spareContext up to32,768
- Needs 16 GB 16 GB spareContext up to40,960
- Mistral Small 24BMistral AI · Q4_K_M · downloadNeeds 14 GB 18 GB spareContext up to32,768
- Mistral Small 22BMistral AI · Q4_K_M · downloadNeeds 13 GB 19 GB spareContext up to32,768
- Needs 9.8 GB 22 GB spareContext up to40,960
- Needs 9.8 GB 22 GB spareContext up to16,384
- Qwen2.5 14BAlibaba · Q4_K_M · downloadNeeds 9.6 GB 22 GB spareContext up to32,768
- DeepSeek-R1 Distill 14BDeepSeek · Q4_K_M · downloadNeeds 9.6 GB 22 GB spareContext up to126,255
- Qwen2.5 Coder 14BAlibaba · Q4_K_M · downloadNeeds 9.6 GB 22 GB spareContext up to32,768
- Needs 9.4 GB 23 GB spareContext up to40,960
- Phi-3 medium 14BMicrosoft · Q4_K_M · downloadNeeds 9.3 GB 23 GB spareContext up to123,158
- OLMo 2 13BAllen Institute for AI · Q4_K_M · downloadNeeds 11 GB 21 GB spareContext up to4,096
- Mistral Nemo 12BMistral AI · Q4_K_M · downloadNeeds 8.1 GB 24 GB spareContext up to131,072
- Needs 5.9 GB 26 GB spareContext up to40,960
- DeepSeek-R1 0528 8BDeepSeek · Q4_K_M · downloadNeeds 5.9 GB 26 GB spareContext up to131,072
- DeepSeek-R1 Distill 8BDeepSeek · Q4_K_M · downloadNeeds 5.6 GB 26 GB spareContext up to131,072
- Dolphin 3.0 8BCognitive Computations · Q4_K_M · downloadNeeds 5.6 GB 26 GB spareContext up to131,072
- Qwen2.5 7BAlibaba · Q4_K_M · downloadNeeds 5.1 GB 27 GB spareContext up to32,768
- Qwen2.5 Coder 7BAlibaba · Q4_K_M · downloadNeeds 5.1 GB 27 GB spareContext up to32,768
- DeepSeek-R1 Distill 7BDeepSeek · Q4_K_M · downloadNeeds 5.1 GB 27 GB spareContext up to131,072
- Needs 6.7 GB 25 GB spareContext up to4,096
- Mistral 7BMistral AI · Q4_K_M · downloadNeeds 5.1 GB 27 GB spareContext up to32,768
- Needs 3.5 GB 29 GB spareContext up to40,960
- Phi-4 mini 3.8BMicrosoft · Q4_K_M · downloadNeeds 3.3 GB 29 GB spareContext up to131,072
- Phi-3 mini 3.8BMicrosoft · Q4_K_M · downloadNeeds 4.2 GB 28 GB spareContext up to4,096
- Qwen2.5 3BAlibaba · Q4_K_M · downloadNeeds 2.4 GB 30 GB spareContext up to32,768
- Qwen2.5 Coder 3BAlibaba · Q4_K_M · downloadNeeds 2.4 GB 30 GB spareContext up to32,768
- Qwen3 1.7BAlibaba · Q4_K_M · downloadNeeds 2.2 GB 30 GB spareContext up to40,960
- DeepSeek-R1 Distill 1.5BDeepSeek · Q4_K_M · downloadNeeds 1.6 GB 30 GB spareContext up to131,072
- SmolLM2 1.7BHugging Face · Q4_K_M · downloadNeeds 2.3 GB 30 GB spareContext up to8,192
- Qwen2.5 1.5BAlibaba · Q4_K_M · downloadNeeds 1.5 GB 30 GB spareContext up to32,768
- Qwen2.5 Coder 1.5BAlibaba · Q4_K_M · downloadNeeds 1.5 GB 30 GB spareContext up to32,768
- TinyLlama 1.1BTinyLlama · Q4_K_M · downloadNeeds 1.2 GB 31 GB spareContext up to2,048
- Qwen3 0.6BAlibaba · Q4_K_M · downloadNeeds 1.4 GB 31 GB spareContext up to40,960
- Qwen2.5 0.5BAlibaba · Q4_K_M · downloadNeeds 0.9 GB 31 GB spareContext up to32,768
- SmolLM2 360MHugging Face · Q4_K_M · downloadNeeds 0.9 GB 31 GB spareContext up to8,192
Won’t fit
3- Qwen2.5 72BAlibaba · Q4_K_M · downloadNeeds 46 GB 14 GB short
- DeepSeek-R1 Distill 70BDeepSeek · Q4_K_M · downloadNeeds 42 GB 9.8 GB short
- Needs 34 GB 2.1 GB short
Browse by graphics card or Mac
NVIDIA
- GeForce RTX 5090
- GeForce RTX 5080
- GeForce RTX 5070 Ti
- GeForce RTX 5070
- GeForce RTX 5060 Ti 16 GB
- GeForce RTX 5060 Ti 8 GB
- GeForce RTX 5060
- GeForce RTX 5050
- GeForce RTX 4090
- GeForce RTX 4080 SUPER
- GeForce RTX 4080
- GeForce RTX 4070 Ti SUPER
- GeForce RTX 4070 Ti
- GeForce RTX 4070 SUPER
- GeForce RTX 4070
- GeForce RTX 4060 Ti 16 GB
- GeForce RTX 4060 Ti 8 GB
- GeForce RTX 4060
Frequently asked questions
How do you decide whether a model fits?
We add the size of the model file, the memory its context needs, and a small allowance for the program running it, then compare that with the memory your graphics card or Mac can give it. The file size and the model’s design come from the publisher’s own pages; the allowance is our estimate.
What does “Partly on GPU” mean?
The model is too big for the graphics card alone, but the rest fits in your computer’s RAM. It will run, but much more slowly, because the part in RAM is worked through by the processor.
Why don’t you show how fast it will run?
Hardware makers and model publishers don’t publish tokens-per-second figures, so there is no source we could cite. We only show what we can back up.
Why does a longer context need more memory?
A model keeps working notes for every token in the conversation. The longer the context you load it with, the more memory those notes take, on top of the model file itself.
Did this tool do what you needed?
Related tools
Pick a local model and context length and see how much GPU memory it needs, and which cards and Macs fit it.
Set up local AI on Windows or Mac, step by step.
What running a model on your own hardware costs, compared with the API.
Estimate monthly API cost across models, including caching and batch discounts.
See how many messages a day it takes before a ChatGPT, Claude or Gemini plan beats paying per token.