What AI can your computer run?
Pick your graphics card or Mac and see which local models fit in its memory, before you download gigabytes you can’t use.
34 of 42 model downloads fit in the 16 GB VRAM of the RTX 5060 Ti 16 GB
at 4,096 tokens of context- Mistral Small 24B Q4_K_M
- Mistral Small 22B Q4_K_M
- Qwen3 14B Q4_K_M
- Phi-4 14B Q4_K_M
- Qwen2.5 14B Q4_K_M
Next step up: Qwen3 32B needs 20 GB.
Full results for RTX 5060 Ti 16 GBLocal AI tools
Run models on your own machineWhat AI Can My Computer Run?
Pick your graphics card or Mac and see which local AI models fit in its memory.
LLM VRAM Calculator
Pick a local model and context length and see how much GPU memory it needs, and which cards and Macs fit it.
Ollama & LM Studio Beginner’s Guide
Set up local AI on Windows or Mac, step by step.
Local AI Electricity Cost Calculator
What running a model on your own hardware costs, compared with the API.
Every graphics card and Mac we check
NVIDIA
- GeForce RTX 5090
- GeForce RTX 5080
- GeForce RTX 5070 Ti
- GeForce RTX 5070
- GeForce RTX 5060 Ti 16 GB
- GeForce RTX 5060 Ti 8 GB
- GeForce RTX 5060
- GeForce RTX 5050
- GeForce RTX 4090
- GeForce RTX 4080 SUPER
- GeForce RTX 4080
- GeForce RTX 4070 Ti SUPER
- GeForce RTX 4070 Ti
- GeForce RTX 4070 SUPER
- GeForce RTX 4070
- GeForce RTX 4060 Ti 16 GB
- GeForce RTX 4060 Ti 8 GB
- GeForce RTX 4060
How much VRAM does a model need?
- Qwen3 0.6B
- Qwen3 1.7B
- Qwen3 4B
- Qwen3 8B
- Qwen3 14B
- Qwen3 32B
- Qwen2.5 0.5B
- Qwen2.5 1.5B
- Qwen2.5 3B
- Qwen2.5 7B
- Qwen2.5 14B
- Qwen2.5 32B
- Qwen2.5 72B
- Qwen2.5 Coder 1.5B
- Qwen2.5 Coder 3B
- Qwen2.5 Coder 7B
- Qwen2.5 Coder 14B
- Qwen2.5 Coder 32B
- Phi-4 14B
- Phi-4 mini 3.8B
- Phi-3 mini 3.8B
- Phi-3 medium 14B
- Mistral 7B
- Mistral Nemo 12B
- Mistral Small 22B
- Mistral Small 24B
- DeepSeek-R1 Distill 1.5B
- DeepSeek-R1 Distill 7B
- DeepSeek-R1 Distill 8B
- DeepSeek-R1 Distill 14B
- DeepSeek-R1 Distill 32B
- DeepSeek-R1 Distill 70B
- DeepSeek-R1 0528 8B
- SmolLM2 360M
- SmolLM2 1.7B
- OLMo 2 7B
- OLMo 2 13B
- TinyLlama 1.1B
- Dolphin 3.0 8B
More tools
Text, AI plans and costs, and developer checksFrom the makers’ own pages
Memory comes from NVIDIA’s and Apple’s spec pages, file sizes from the download page, each linked.
No made-up speeds
Nobody publishes tokens per second, so we don’t show them. Our estimates are labeled.
Dated and re-checked
New cards and models arrive often, so every figure shows when we last checked it.