← CanIRunLocal · All hardware · All models

Can a M2 Max (38c GPU) 64GB run SmolLM2 135M?

Yes. SmolLM2 135M fits in fast memory on M2 Max (38c GPU) 64GB at FP16 (0.9 GB needed, 48.0 GB usable), about 1185 tok/s (estimate).

Hardware: M2 Max (38c GPU) 64GB · Model: SmolLM2 135M

M2 Max (38c GPU) 64GB has 64 GB of unified memory and 400 GB/s of memory bandwidth. M1 Max (32c GPU) 64GB and M2 Max (30c GPU) 64GB and M3 Max (40c GPU) 64GB have the same memory and bandwidth, so the fit numbers match; this page is M2 Max (38c GPU) 64GB. The checker leaves macOS a share of unified memory, so Ollama can use 48.0 GB. SmolLM2 135M (0.135B, HuggingFace) at FP16 is a 0.27 GB download and needs 0.9 GB with headroom for about 8k tokens.

Best quantFP16
Download size0.27 GB
Memory needed0.9 GB
Usable fast memory48.0 GB
Fitfits in fast memory
Estimated speed~1185 tok/s (estimate)
Commandollama run smollm2:135m
Open M2 Max (38c GPU) 64GB in the checker

Estimates, not benchmarks. Model sizes are ollama.com download sizes; memory needed adds headroom for ~8k tokens of context; speeds are rough figures from memory bandwidth. Data updated 2026-10-23.

A project by OnDevice Labs · llms.txt