← CanIRunLocal · All hardware · All models

Can a M4 16GB run Qwen3.5 9B?

Yes. Qwen3.5 9B fits in fast memory on M4 16GB at Q4_K_M (8 GB needed, 10.7 GB usable), about 15 tok/s (estimate).

Hardware: M4 16GB · Model: Qwen3.5 9B

M4 16GB has 16 GB of unified memory and 120 GB/s of memory bandwidth. The checker leaves macOS a share of unified memory, so Ollama can use 10.7 GB. Qwen3.5 9B (9.65B, Alibaba) at Q4_K_M is a 6.6 GB download and needs 8 GB with headroom for about 8k tokens.

Best quantQ4_K_M
Download size6.6 GB
Memory needed8 GB
Usable fast memory10.7 GB
Fitfits in fast memory
Estimated speed~15 tok/s (estimate)
Commandollama run qwen3.5:9b-q4_K_M
Open M4 16GB in the checker

Estimates, not benchmarks. Model sizes are ollama.com download sizes; memory needed adds headroom for ~8k tokens of context; speeds are rough figures from memory bandwidth. Data updated 2026-10-23.

A project by OnDevice Labs · llms.txt