← CanIRunLocal · All hardware · All models

Can a M1 Max (24c GPU) 32GB run SmolLM2 360M?

Yes. SmolLM2 360M fits in fast memory on M1 Max (24c GPU) 32GB at FP16 (1.3 GB needed, 24.0 GB usable), about 438 tok/s (estimate).

Hardware: M1 Max (24c GPU) 32GB · Model: SmolLM2 360M

M1 Max (24c GPU) 32GB has 32 GB of unified memory and 400 GB/s of memory bandwidth. M1 Max (32c GPU) 32GB and M2 Max (30c GPU) 32GB and M2 Max (38c GPU) 32GB have the same memory and bandwidth, so the fit numbers match; this page is M1 Max (24c GPU) 32GB. The checker leaves macOS a share of unified memory, so Ollama can use 24.0 GB. SmolLM2 360M (0.362B, HuggingFace) at FP16 is a 0.73 GB download and needs 1.3 GB with headroom for about 8k tokens.

Best quantFP16
Download size0.73 GB
Memory needed1.3 GB
Usable fast memory24.0 GB
Fitfits in fast memory
Estimated speed~438 tok/s (estimate)
Commandollama run smollm2:360m
Open M1 Max (24c GPU) 32GB in the checker

Estimates, not benchmarks. Model sizes are ollama.com download sizes; memory needed adds headroom for ~8k tokens of context; speeds are rough figures from memory bandwidth. Data updated 2026-10-23.

A project by OnDevice Labs · llms.txt