← CanIRunLocal · All hardware

What local LLMs run on M3 Pro 36GB?

With 36 GB unified memory (about 27.0 GB usable by the GPU), these are the best open models that fit. The top pick is Qwen3 30B-A3B (MoE) at Q4_K_M (~20.4 GB, ~29 tok/s): ollama run qwen3:30b.

Best for coding: Qwen3-Coder 30B-A3B (MoE) (qwen3-coder:30b), Qwen3 30B-A3B (MoE) (qwen3:30b), gpt-oss 20B (MoE, MXFP4) (gpt-oss:20b).

Runtimes available for this hardware: Ollama, LM Studio, llama.cpp, MLX.

Open the interactive checker for M3 Pro 36GB
#ModelQuantMemory neededFitSpeedCommand
1Qwen3 30B-A3B (MoE)Q4_K_M20.4 GBfits in fast memory~29 tok/sollama run qwen3:30b
2Qwen3-Coder 30B-A3B (MoE)Q4_K_M20.4 GBfits in fast memory~29 tok/sollama run qwen3-coder:30b
3gpt-oss 20B (MoE, MXFP4)MXFP415.1 GBfits in fast memory~25 tok/sollama run gpt-oss:20b
4Gemma 3 27BQ4_K_M19 GBfits in fast memory~7 tok/sollama run gemma3:27b
5Qwen3 32BQ4_K_M22.2 GBfits in fast memory~6 tok/sollama run qwen3:32b
6DeepSeek R1 Distill Qwen 32BQ4_K_M22.2 GBfits in fast memory~6 tok/sollama run deepseek-r1:32b
7Clef 27B (Cloudflare, decision)Default19.9 GBfits in fast memory~7 tok/sollama run clef:27b
8Qwen3.8 27BDefault19.9 GBfits in fast memory~7 tok/sollama run qwen3.8:27b
9Llama 3.2 Vision 11BQ8_013.1 GBfits in fast memory~10 tok/sollama run llama3.2-vision:11b-instruct-q8_0
10Mistral Nemo 12BQ8_014.2 GBfits in fast memory~9 tok/sollama run mistral-nemo:12b-instruct-2407-q8_0
11Gemma 3 12BQ8_014.2 GBfits in fast memory~9 tok/sollama run gemma3:12b-it-q8_0
12Nimble v3 9B (Bespoke Labs, decision)Q8_010.6 GBfits in fast memory~13 tok/sollama run nimble-v3:9b-q8_0

Estimates, not benchmarks. Model sizes are ollama.com download sizes; memory needed adds headroom for ~8k tokens of context; speeds are rough figures from memory bandwidth. Data updated 2026-10-14.

A project by OnDevice Labs · llms.txt