← CanIRunLocal · All hardware · All models

Can a M4 Max (32c GPU) 36GB run gpt-oss 120B (MoE, MXFP4)?

No. gpt-oss 120B (MoE, MXFP4) does not fit on M4 Max (32c GPU) 36GB: MXFP4 needs 67.3 GB and 27.0 GB is usable.

Hardware: M4 Max (32c GPU) 36GB · Model: gpt-oss 120B (MoE, MXFP4)

M4 Max (32c GPU) 36GB has 36 GB of unified memory and 410 GB/s of memory bandwidth. Mac Studio M4 Max (32c GPU) 36GB has the same memory and bandwidth, so the fit numbers match; this page is M4 Max (32c GPU) 36GB. The checker leaves macOS a share of unified memory, so Ollama can use 27.0 GB. gpt-oss 120B (MoE, MXFP4) (117B, 5.1B active, OpenAI) at MXFP4 is a 65 GB download and needs 67.3 GB with headroom for about 8k tokens.

Best quantMXFP4
Download size65 GB
Memory needed67.3 GB
Usable fast memory27.0 GB
Fitdoes not fit
Estimated speedno estimate, it does not fit
Commandollama run gpt-oss:120b

Smallest hardware that runs it: M2 Max (38c GPU) 96GB at MXFP4 (fits in fast memory, 67.3 GB needed, 72.0 GB usable, about 56 tok/s (estimate)). Can a M2 Max (38c GPU) 96GB run gpt-oss 120B (MoE, MXFP4)?

A smaller OpenAI model that fits this hardware: gpt-oss 20B (MoE, MXFP4) at MXFP4 (fits in fast memory, 15.1 GB). Can a M4 Max (32c GPU) 36GB run gpt-oss 20B (MoE, MXFP4)?

Open M4 Max (32c GPU) 36GB in the checker

Estimates, not benchmarks. Model sizes are ollama.com download sizes; memory needed adds headroom for ~8k tokens of context; speeds are rough figures from memory bandwidth. Data updated 2026-10-23.

A project by OnDevice Labs · llms.txt