← CanIRunLocal · All hardware · All models
With 64 GB unified memory (about 54.4 GB usable by the GPU), these are the best open models that fit. The top pick is Nemotron 3.5 Bolt 74B-A9B (MoE, IQ2-class) at Default (~27.7 GB, ~52 tok/s): ollama run nemotron-3.5-bolt:74b-a9b.
DGX Spark 64GB has 64 GB of unified memory and the same 273 GB/s bandwidth as the DGX Spark 128GB. The OEM brands are ASUS, Dell, HP, MSI, Acer, and Gigabyte.
Best for coding: Nemotron 3.5 Bolt 74B-A9B (MoE, IQ2-class) (nemotron-3.5-bolt:74b-a9b), Qwen3.6 35B-A3B (MoE) (qwen3.6:35b-a3b-q8_0), Laguna XS 2.1 33B-A3B (MoE) (laguna-xs-2.1:q8_0).
Runtimes available for this hardware: Ollama, LM Studio, llama.cpp, vLLM.
Open the interactive checker for DGX Spark 64GB (ASUS, Dell, HP, MSI, Acer, Gigabyte)| # | Model | Quant | Memory needed | Fit | Speed | Command |
|---|---|---|---|---|---|---|
| 1 | Nemotron 3.5 Bolt 74B-A9B (MoE, IQ2-class) | Default | 27.7 GB | fits in fast memory | ~52 tok/s | ollama run nemotron-3.5-bolt:74b-a9b |
| 2 | Qwen3-Next 80B-A3B (MoE) | Q4_K_M | 52.4 GB | fits in fast memory | ~84 tok/s | ollama run qwen3-next:80b |
| 3 | Qwen3.5 35B-A3B (MoE) | Q8_0 | 40.9 GB | fits in fast memory | ~48 tok/s | ollama run qwen3.5:35b-a3b-q8_0 |
| 4 | Qwen3.6 35B-A3B (MoE) | Q8_0 | 40.9 GB | fits in fast memory | ~48 tok/s | ollama run qwen3.6:35b-a3b-q8_0 |
| 5 | Laguna XS 2.1 33B-A3B (MoE) | Q8_0 | 37.4 GB | fits in fast memory | ~49 tok/s | ollama run laguna-xs-2.1:q8_0 |
| 6 | GLM-4.7-Flash 30B-A3B (MoE) | Q8_0 | 33.4 GB | fits in fast memory | ~51 tok/s | ollama run glm-4.7-flash:q8_0 |
| 7 | Jais 3 MoVA 36B-A4B (MoE) | Q8_0 | 41.3 GB | fits in fast memory | ~35 tok/s | ollama run hf.co/IFM/Jais-3-MoVA-36B-A4B-GGUF:Q8_0 |
| 8 | Qwen3-Coder 30B-A3B (MoE) | Q8_0 | 33.4 GB | fits in fast memory | ~45 tok/s | ollama run qwen3-coder:30b-a3b-q8_0 |
| 9 | Qwen3-VL 30B-A3B (MoE) | Q8_0 | 35.7 GB | fits in fast memory | ~48 tok/s | ollama run qwen3-vl:30b-a3b-instruct-q8_0 |
| 10 | Nemotron 3.5 Lightning 30B-A3B (MoE) | Q8_0 | 36.4 GB | fits in fast memory | ~47 tok/s | ollama run nemotron-3.5-lightning:30b-a3b-q8_0 |
| 11 | Qwen3 30B-A3B (MoE) | Q8_0 | 34.4 GB | fits in fast memory | ~44 tok/s | ollama run qwen3:30b-a3b-q8_0 |
| 12 | Ornith-1.5 35B-A3B (MoE) | Default | 24.8 GB | fits in fast memory | ~80 tok/s | ollama run ornith-1.5:35b |
| 13 | Flint 40B-A2.5B (MoE) | Q4_1 | 27.6 GB | fits in fast memory | ~96 tok/s | ollama run flint:40b-a2b-q4_1 |
| 14 | gpt-oss 20B (MoE, MXFP4) | MXFP4 | 15.1 GB | fits in fast memory | ~65 tok/s | ollama run gpt-oss:20b |
| 15 | Gemma 4 26B-A4B (MoE) | Q8_0 | 29.6 GB | fits in fast memory | ~38 tok/s | ollama run gemma4:26b-a4b-it-q8_0 |
| 16 | LFM2.5 24B-A2B (MoE) | Q8_0 | 26.2 GB | fits in fast memory | ~75 tok/s | ollama run lfm2.5:24b-a2b-q8_0 |
| 17 | Bonsai 2 27B (ternary) | Q2_0 | 10.6 GB | fits in fast memory | ~25 tok/s | ollama run bonsai-2:27b |
| 18 | Bonsai 2 9B (ternary) | Q2_0 | 4.6 GB | fits in fast memory | ~64 tok/s | ollama run bonsai-2:9b |
| 19 | pplx-decider 27B (Perplexity, decision) | Q4_K_M | 19.3 GB | fits in fast memory | ~12 tok/s | ollama run pplx-decider:27b |
| 20 | Hy-Memory 30B-A3B (MoE, memory) | Q8_0 | 33.3 GB | fits in fast memory | ~49 tok/s | ollama run hf.co/tencent/Hy-Memory-30B-A3B-GGUF:Q8_0 |
| 21 | Mixtral 8x7B (MoE) | Q8_0 | 51.8 GB | fits in fast memory | ~11 tok/s | ollama run mixtral:8x7b-instruct-v0.1-q8_0 |
| 22 | LFM2.5 8B-A1B (MoE) | Q8_0 | 9.8 GB | fits in fast memory | ~148 tok/s | ollama run lfm2.5:8b-a1b-q8_0 |
| 23 | DeepSeek R1 Distill Llama 70B | Q4_K_M | 47.1 GB | fits in fast memory | ~5 tok/s | ollama run deepseek-r1:70b |
| 24 | Llama 3.3 70B | Q5_K_M | 54.1 GB | fits in fast memory | ~4 tok/s | ollama run llama3.3:70b-instruct-q5_K_M |
| 25 | Qwen3 14B | Q8_0 | 17.3 GB | fits in fast memory | ~13 tok/s | ollama run qwen3:14b-q8_0 |
| 26 | DeepSeek R1 Distill Qwen 14B | Q8_0 | 17.3 GB | fits in fast memory | ~13 tok/s | ollama run deepseek-r1:14b-qwen-distill-q8_0 |
| 27 | Phi-4 14B | Q8_0 | 17.3 GB | fits in fast memory | ~13 tok/s | ollama run phi4:14b-q8_0 |
| 28 | Mistral Small 24B | Q8_0 | 26.8 GB | fits in fast memory | ~8 tok/s | ollama run mistral-small:24b-instruct-2501-q8_0 |
| 29 | Ministral 3 14B | Q8_0 | 16.6 GB | fits in fast memory | ~14 tok/s | ollama run ministral-3:14b-instruct-2512-q8_0 |
| 30 | Devstral Small 2 24B | Q8_0 | 27.8 GB | fits in fast memory | ~8 tok/s | ollama run devstral-small-2:24b-instruct-2512-q8_0 |
| 31 | Mistral Nemo 12B | Q8_0 | 14.2 GB | fits in fast memory | ~16 tok/s | ollama run mistral-nemo:12b-instruct-2407-q8_0 |
| 32 | Gemma 3 12B | Q8_0 | 14.6 GB | fits in fast memory | ~16 tok/s | ollama run gemma3:12b-it-q8_0 |
| 33 | Gemma 4 12B | Q8_0 | 14.6 GB | fits in fast memory | ~16 tok/s | ollama run gemma4:12b-it-q8_0 |
| 34 | Muse Glimmer 30B | Q8_0 | 33.4 GB | fits in fast memory | ~7 tok/s | ollama run muse-glimmer:30b-q8_0 |
| 35 | Granite 4.2 30B | Q8_0 | 33.1 GB | fits in fast memory | ~7 tok/s | ollama run granite4.2:30b-q8_0 |
| 36 | North Mini Code 1.0 30B (MoE) | Q8_0 | 34.1 GB | fits in fast memory | ~6 tok/s | ollama run north-mini-code-1.0:q8_0 |
| 37 | Qwen3.5 27B | Q8_0 | 32.3 GB | fits in fast memory | ~7 tok/s | ollama run qwen3.5:27b-q8_0 |
| 38 | Qwen3.6 27B | Q8_0 | 32.3 GB | fits in fast memory | ~7 tok/s | ollama run qwen3.6:27b-q8_0 |
| 39 | Qwen3.5 9B | Q8_0 | 11.4 GB | fits in fast memory | ~20 tok/s | ollama run qwen3.5:9b-q8_0 |
| 40 | Gemma 3 27B | Q8_0 | 32.3 GB | fits in fast memory | ~7 tok/s | ollama run gemma3:27b-it-q8_0 |
| 41 | Llama 3.2 Vision 11B | Q8_0 | 13.5 GB | fits in fast memory | ~17 tok/s | ollama run llama3.2-vision:11b-instruct-q8_0 |
| 42 | DeepSeek Coder V2 Lite 16B (MoE) | Q8_0 | 18 GB | fits in fast memory | ~60 tok/s | ollama run deepseek-coder-v2:16b-lite-instruct-q8_0 |
| 43 | Ornith-1.5 9B | Default | 8 GB | fits in fast memory | ~31 tok/s | ollama run ornith-1.5:9b |
| 44 | Clef 27B (Cloudflare, decision) | Q8_0 | 32.3 GB | fits in fast memory | ~7 tok/s | ollama run clef:27b-q8_0 |
| 45 | Qwen3.8 27B | Q8_0 | 32.3 GB | fits in fast memory | ~7 tok/s | ollama run qwen3.8:27b-q8_0 |
| 46 | d3 27B (vLLM Semantic Router, decision) | Q8_0 | 32.3 GB | fits in fast memory | ~7 tok/s | ollama run d3:27b-q8_0 |
| 47 | Qwen3 32B | Q8_0 | 37.2 GB | fits in fast memory | ~6 tok/s | ollama run qwen3:32b-q8_0 |
| 48 | DeepSeek R1 Distill Qwen 32B | Q8_0 | 37.2 GB | fits in fast memory | ~6 tok/s | ollama run deepseek-r1:32b-qwen-distill-q8_0 |
| 49 | Nimble v3 9B (Bespoke Labs, decision) | Q8_0 | 10.6 GB | fits in fast memory | ~22 tok/s | ollama run nimble-v3:9b-q8_0 |
| 50 | Nimble 9B (Bespoke Labs, decision) | Q8_0 | 10.6 GB | fits in fast memory | ~22 tok/s | ollama run nimble:9b-q8_0 |
| 51 | Kev 9B (decision) | Q8_0 | 10.6 GB | fits in fast memory | ~22 tok/s | ollama run kev:9b-q8_0 |
| 52 | Jais 3 32B | Q8_0 | 39.3 GB | fits in fast memory | ~6 tok/s | ollama run hf.co/IFM/Jais-3-32B-GGUF:Q8_0 |
| 53 | Gemma 4 31B | Q8_0 | 36.5 GB | fits in fast memory | ~6 tok/s | ollama run gemma4:31b-it-q8_0 |
| 54 | Granite 4.2 8B | Q8_0 | 10.3 GB | fits in fast memory | ~22 tok/s | ollama run granite4.2:8b-q8_0 |
| 55 | Qwen3-VL 32B | Q8_0 | 38.6 GB | fits in fast memory | ~6 tok/s | ollama run qwen3-vl:32b-instruct-q8_0 |
| 56 | d3 9B (vLLM Semantic Router, decision) | Q8_0 | 11.4 GB | fits in fast memory | ~20 tok/s | ollama run d3:9b-q8_0 |
| 57 | Ministral 3 8B | Q8_0 | 11.3 GB | fits in fast memory | ~21 tok/s | ollama run ministral-3:8b-instruct-2512-q8_0 |
| 58 | Qwen3-VL 8B | Q8_0 | 11.2 GB | fits in fast memory | ~21 tok/s | ollama run qwen3-vl:8b-instruct-q8_0 |
| 59 | Qwen3 8B | Q8_0 | 9.9 GB | fits in fast memory | ~23 tok/s | ollama run qwen3:8b-q8_0 |
| 60 | DeepSeek R1 0528 Qwen3 8B | Q8_0 | 9.9 GB | fits in fast memory | ~23 tok/s | ollama run deepseek-r1:8b-0528-qwen3-q8_0 |
| 61 | DeepSeek R1 Distill Qwen 7B | Q8_0 | 9.1 GB | fits in fast memory | ~25 tok/s | ollama run deepseek-r1:7b-qwen-distill-q8_0 |
| 62 | Qwen 2.5 VL 7B | Q8_0 | 10.8 GB | fits in fast memory | ~22 tok/s | ollama run qwen2.5vl:7b-q8_0 |
| 63 | MiniCPM-V 2.6 8B | Q8_0 | 10.5 GB | fits in fast memory | ~23 tok/s | ollama run minicpm-v:8b-2.6-q8_0 |
| 64 | Gemma 4 E4B (effective 4.5B) | Q8_0 | 10.3 GB | fits in fast memory | ~23 tok/s | ollama run gemma4:e4b-it-q8_0 |
| 65 | Clef-Flash 9B (Cloudflare, decision) | Q8_0 | 12.4 GB | fits in fast memory | ~19 tok/s | ollama run clef-flash:9b-q8_0 |
| 66 | Gemma 3n E4B (on-device) | Q8_0 | 10.5 GB | fits in fast memory | ~22 tok/s | ollama run gemma3n:e4b-it-q8_0 |
| 67 | Nemotron Labs Dory 1.0 4B | Q5_K_M | 4.5 GB | fits in fast memory | ~56 tok/s | ollama run hf.co/nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-GGUF:Q5_K_M |
| 68 | Qwen3.5 4B | Q8_0 | 6.4 GB | fits in fast memory | ~39 tok/s | ollama run qwen3.5:4b-q8_0 |
| 69 | Gemma 4 E2B (effective 2.3B) | Q8_0 | 7.2 GB | fits in fast memory | ~34 tok/s | ollama run gemma4:e2b-it-q8_0 |
| 70 | Bonsai 2 4B (ternary) | Q2_0 | 2.8 GB | fits in fast memory | ~128 tok/s | ollama run bonsai-2:4b |
| 71 | Phi-4 Mini 3.8B | Q8_0 | 4.9 GB | fits in fast memory | ~50 tok/s | ollama run phi4-mini:3.8b-q8_0 |
| 72 | Qwen3 4B | Q8_0 | 5.2 GB | fits in fast memory | ~47 tok/s | ollama run qwen3:4b-q8_0 |
| 73 | Granite 4.2 3B | Q8_0 | 4.7 GB | fits in fast memory | ~53 tok/s | ollama run granite4.2:3b-q8_0 |
| 74 | Qwen3-VL 4B | Q8_0 | 6.3 GB | fits in fast memory | ~40 tok/s | ollama run qwen3-vl:4b-instruct-q8_0 |
| 75 | Kev 4B (decision) | Q8_0 | 5.3 GB | fits in fast memory | ~46 tok/s | ollama run kev:4b-q8_0 |
| 76 | Gemma 3 4B | Q8_0 | 6.2 GB | fits in fast memory | ~41 tok/s | ollama run gemma3:4b-it-q8_0 |
| 77 | Llama 3.2 3B | Q8_0 | 4.2 GB | fits in fast memory | ~60 tok/s | ollama run llama3.2:3b-instruct-q8_0 |
| 78 | Gemma 3n E2B (on-device) | Q8_0 | 7.8 GB | fits in fast memory | ~30 tok/s | ollama run gemma3n:e2b-it-q8_0 |
| 79 | tev1 4B (Together AI, decision) | Q8_0 | 5.4 GB | fits in fast memory | ~45 tok/s | ollama run tev1:4b-q8_0 |
| 80 | Ministral 3 3B | Q8_0 | 5.6 GB | fits in fast memory | ~46 tok/s | ollama run ministral-3:3b-instruct-2512-q8_0 |
| 81 | Jais 3 7B | BF16 | 19.1 GB | fits in fast memory | ~11 tok/s | ollama run hf.co/IFM/Jais-3-7B-GGUF:BF16 |
| 82 | d1 3B (Liquid AI, decision) | Q8_0 | 4.8 GB | fits in fast memory | ~55 tok/s | ollama run d1:3b |
| 83 | d3 4B (vLLM Semantic Router, decision) | Q8_0 | 6.9 GB | fits in fast memory | ~35 tok/s | ollama run d3:4b-q8_0 |
| 84 | Jais 3 3.7B | BF16 | 11 GB | fits in fast memory | ~20 tok/s | ollama run hf.co/IFM/Jais-3-3.7B-GGUF:BF16 |
| 85 | Qwen3.5 2B | Q8_0 | 3.8 GB | fits in fast memory | ~76 tok/s | ollama run qwen3.5:2b-q8_0 |
| 86 | Qwen3-VL 2B | Q8_0 | 3.8 GB | fits in fast memory | ~76 tok/s | ollama run qwen3-vl:2b-instruct-q8_0 |
| 87 | Qwen3 1.7B | Q8_0 | 2.9 GB | fits in fast memory | ~93 tok/s | ollama run qwen3:1.7b-q8_0 |
| 88 | d3 2B (vLLM Semantic Router, decision) | Q8_0 | 4.3 GB | fits in fast memory | ~64 tok/s | ollama run d3:2b-q8_0 |
| 89 | MiniCPM5 2B | F16 | 5.8 GB | fits in fast memory | ~41 tok/s | ollama run hf.co/openbmb/MiniCPM5-2B-GGUF:F16 |
| 90 | DeepSeek R1 Distill Qwen 1.5B | Q8_0 | 2.6 GB | fits in fast memory | ~108 tok/s | ollama run deepseek-r1:1.5b-qwen-distill-q8_0 |
| 91 | SmolLM2 1.7B | Q8_0 | 2.5 GB | fits in fast memory | ~114 tok/s | ollama run smollm2:1.7b |
| 92 | Qwen 2.5 72B | Q4_K_M | 51.1 GB | fits in fast memory | ~4 tok/s | ollama run qwen2.5:72b |
| 93 | Bonsai 2 2B (ternary) | Q2_0 | 2 GB | fits in fast memory | ~225 tok/s | ollama run bonsai-2:2b |
| 94 | GLM-OCR 0.9B | BF16 | 3.7 GB | fits in fast memory | ~76 tok/s | ollama run glm-ocr:latest |
| 95 | strands-decider 2B (Strands Agents, decision) | Default | 2.7 GB | fits in fast memory | ~102 tok/s | ollama run strands-decider:2b |
| 96 | Qwen 2.5 14B | Q8_0 | 17.3 GB | fits in fast memory | ~13 tok/s | ollama run qwen2.5:14b-instruct-q8_0 |
| 97 | Qwen 2.5 Coder 14B | Q8_0 | 17.3 GB | fits in fast memory | ~13 tok/s | ollama run qwen2.5-coder:14b-instruct-q8_0 |
| 98 | MiniCPM-V 4.6 1B | Q8_0 | 2.9 GB | fits in fast memory | ~108 tok/s | ollama run minicpm-v4.6:q8_0 |
| 99 | Llama 3.2 1B | Q8_0 | 2 GB | fits in fast memory | ~158 tok/s | ollama run llama3.2:1b |
| 100 | Jais 3 0.9B | BF16 | 2.8 GB | fits in fast memory | ~95 tok/s | ollama run hf.co/IFM/Jais-3-0.9B-GGUF:BF16 |
| 101 | LFM2.5 1.2B Thinking | Q8_0 | 1.9 GB | fits in fast memory | ~171 tok/s | ollama run lfm2.5-thinking:1.2b-q8_0 |
| 102 | Qwen 2.5 32B | Q8_0 | 37.2 GB | fits in fast memory | ~6 tok/s | ollama run qwen2.5:32b-instruct-q8_0 |
| 103 | Qwen 2.5 Coder 32B | Q8_0 | 37.2 GB | fits in fast memory | ~6 tok/s | ollama run qwen2.5-coder:32b-instruct-q8_0 |
| 104 | Gemma 3 1B | Q8_0 | 1.8 GB | fits in fast memory | ~186 tok/s | ollama run gemma3:1b-it-q8_0 |
| 105 | Llama 3.1 8B | Q8_0 | 9.5 GB | fits in fast memory | ~24 tok/s | ollama run llama3.1:8b-instruct-q8_0 |
| 106 | Qwen 2.5 7B | Q8_0 | 9.1 GB | fits in fast memory | ~25 tok/s | ollama run qwen2.5:7b-instruct-q8_0 |
| 107 | Qwen 2.5 Coder 7B | Q8_0 | 9.1 GB | fits in fast memory | ~25 tok/s | ollama run qwen2.5-coder:7b-instruct-q8_0 |
| 108 | Mistral 7B v0.3 | Q8_0 | 8.7 GB | fits in fast memory | ~27 tok/s | ollama run mistral:7b-instruct-q8_0 |
| 109 | LLaVA 1.6 7B | Q8_0 | 9.1 GB | fits in fast memory | ~26 tok/s | ollama run llava:7b-v1.6-vicuna-q8_0 |
| 110 | Code Llama 7B | Q8_0 | 8.1 GB | fits in fast memory | ~28 tok/s | ollama run codellama:7b-instruct-q8_0 |
| 111 | Qwen3.5 0.8B | Q8_0 | 2 GB | fits in fast memory | ~205 tok/s | ollama run qwen3.5:0.8b-q8_0 |
| 112 | Kev 0.8B (decision) | Q8_0 | 1.5 GB | fits in fast memory | ~253 tok/s | ollama run kev:0.8b-q8_0 |
| 113 | Qwen3 0.6B | Q8_0 | 1.5 GB | fits in fast memory | ~247 tok/s | ollama run qwen3:0.6b-q8_0 |
| 114 | d1-omni 600M (Liquid AI, decision) | Q8_0 | 1.8 GB | fits in fast memory | ~241 tok/s | ollama run d1-omni:600m |
| 115 | Qwen 2.5 3B | Q8_0 | 4.1 GB | fits in fast memory | ~62 tok/s | ollama run qwen2.5:3b-instruct-q8_0 |
| 116 | Laya 421M (Convai, decision) | BF16 | 1.5 GB | fits in fast memory | ~244 tok/s | ollama run laya:421m-english-bf16 |
| 117 | SmolLM2 360M | FP16 | 1.3 GB | fits in fast memory | ~280 tok/s | ollama run smollm2:360m |
| 118 | SmolLM2 135M | FP16 | 0.9 GB | fits in fast memory | ~758 tok/s | ollama run smollm2:135m |
| 119 | Qwen 2.5 Coder 1.5B | Q8_0 | 2.3 GB | fits in fast memory | ~128 tok/s | ollama run qwen2.5-coder:1.5b-instruct-q8_0 |
Estimates, not benchmarks. Model sizes are ollama.com download sizes; memory needed adds headroom for ~8k tokens of context; speeds are rough figures from memory bandwidth. Data updated 2026-10-23.
A project by OnDevice Labs · llms.txt