← CanIRunLocal · All hardware · All models

Can I run LFM2.5 1.2B Thinking locally?

Liquid AI · 1.17B parameters · chat, reasoning.

Ollama weight files: Q4_K_M 0.73 GB (lfm2.5-thinking:1.2b); Q8_0 1.2 GB (lfm2.5-thinking:1.2b-q8_0).

Yes on 62 machines in this list. The smallest is M1 8GB: Q8_0, about 1.9 GB, roughly 45 tokens per second, via Ollama. ollama run lfm2.5-thinking:1.2b-q8_0

Setup on DGX Spark 128GB (NVIDIA, ASUS, Dell, Lenovo, HP, MSI, Acer, Gigabyte)

Open LFM2.5 1.2B Thinking in the checker

Hardware that fits

HardwareRuntimeQuantMemoryFitSpeedCommand
M1 8GBOllamaQ8_01.9 GBfits in fast memory~45 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M2 8GBOllamaQ8_01.9 GBfits in fast memory~67 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M3 8GBOllamaQ8_01.9 GBfits in fast memory~67 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 3060 Ti 8GBOllamaQ8_01.9 GBfits in fast memory~224 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 3070 8GBOllamaQ8_01.9 GBfits in fast memory~224 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 4060 8GBOllamaQ8_01.9 GBfits in fast memory~136 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RX 7600 8GBOllamaQ8_01.9 GBfits in fast memory~144 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 3080 10GBOllamaQ8_01.9 GBfits in fast memory~380 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M1 16GBOllamaQ8_01.9 GBfits in fast memory~45 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M2 16GBOllamaQ8_01.9 GBfits in fast memory~67 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M3 16GBOllamaQ8_01.9 GBfits in fast memory~67 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M4 16GBOllamaQ8_01.9 GBfits in fast memory~80 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 3060 12GBOllamaQ8_01.9 GBfits in fast memory~180 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 4070 12GBOllamaQ8_01.9 GBfits in fast memory~252 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 5070 12GBOllamaQ8_01.9 GBfits in fast memory~336 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 4060 Ti 16GBOllamaQ8_01.9 GBfits in fast memory~144 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 4070 Ti Super 16GBOllamaQ8_01.9 GBfits in fast memory~336 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 4080 16GBOllamaQ8_01.9 GBfits in fast memory~359 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 5080 16GBOllamaQ8_01.9 GBfits in fast memory~480 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RX 7800 XT 16GBOllamaQ8_01.9 GBfits in fast memory~312 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RX 9070 XT 16GBOllamaQ8_01.9 GBfits in fast memory~320 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M2 24GBOllamaQ8_01.9 GBfits in fast memory~67 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M3 24GBOllamaQ8_01.9 GBfits in fast memory~67 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M4 24GBOllamaQ8_01.9 GBfits in fast memory~80 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 3090 24GBOllamaQ8_01.9 GBfits in fast memory~468 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 4090 24GBOllamaQ8_01.9 GBfits in fast memory~504 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RX 7900 XTX 24GBOllamaQ8_01.9 GBfits in fast memory~480 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M1 Pro 32GBOllamaQ8_01.9 GBfits in fast memory~133 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M2 Pro 32GBOllamaQ8_01.9 GBfits in fast memory~133 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M4 32GBOllamaQ8_01.9 GBfits in fast memory~80 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M3 Pro 36GBOllamaQ8_01.9 GBfits in fast memory~100 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M4 Max (32c GPU) 36GBOllamaQ8_01.9 GBfits in fast memory~273 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M5 Max (32c GPU) 36GBOllamaQ8_01.9 GBfits in fast memory~307 tok/sollama run lfm2.5-thinking:1.2b-q8_0
RTX 5090 32GBOllamaQ8_01.9 GBfits in fast memory~896 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M4 Pro 48GBOllamaQ8_01.9 GBfits in fast memory~182 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M4 Max (40c GPU) 48GBOllamaQ8_01.9 GBfits in fast memory~364 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M5 Max (40c GPU) 48GBOllamaQ8_01.9 GBfits in fast memory~409 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M1 Max 64GBOllamaQ8_01.9 GBfits in fast memory~267 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M2 Max 64GBOllamaQ8_01.9 GBfits in fast memory~267 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M3 Max 64GBOllamaQ8_01.9 GBfits in fast memory~267 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M4 Max 64GBOllamaQ8_01.9 GBfits in fast memory~364 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M4 Max (40c GPU) 64GBOllamaQ8_01.9 GBfits in fast memory~364 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M5 Max (40c GPU) 64GBOllamaQ8_01.9 GBfits in fast memory~409 tok/sollama run lfm2.5-thinking:1.2b-q8_0
DGX Spark 64GB (ASUS, Dell, HP, MSI, Acer, Gigabyte)OllamaQ8_01.9 GBfits in fast memory~171 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M3 Ultra 96GBOllamaQ8_01.9 GBfits in fast memory~546 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M5 Ultra 96GBOllamaQ8_01.9 GBfits in fast memory~800 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M3 Max 128GBOllamaQ8_01.9 GBfits in fast memory~267 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M4 Max 128GBOllamaQ8_01.9 GBfits in fast memory~364 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M4 Max (40c GPU) 128GBOllamaQ8_01.9 GBfits in fast memory~364 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M5 Max (40c GPU) 128GBOllamaQ8_01.9 GBfits in fast memory~409 tok/sollama run lfm2.5-thinking:1.2b-q8_0
DGX Spark 128GB (NVIDIA, ASUS, Dell, Lenovo, HP, MSI, Acer, Gigabyte)OllamaQ8_01.9 GBfits in fast memory~171 tok/sollama run lfm2.5-thinking:1.2b-q8_0
M2 Ultra 192GBOllamaQ8_01.9 GBfits in fast memory~533 tok/sollama run lfm2.5-thinking:1.2b-q8_0
2x Mac Studio M5 Max (40c GPU) 128GBllama.cppQ8_0 GGUF1.9 GBfits in fast memory~334 tok/sllama-server -hf unsloth/LFM2.5-1.2B-Thinking-GGUF:Q8_0 --rpc node2:50052 -c 8192 # run rpc-server on each other node
Mac Studio M3 Ultra 256GBOllamaQ8_01.9 GBfits in fast memory~546 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M5 Ultra (64c GPU) 256GBOllamaQ8_01.9 GBfits in fast memory~800 tok/sollama run lfm2.5-thinking:1.2b-q8_0
Mac Studio M5 Ultra (80c GPU) 256GBOllamaQ8_01.9 GBfits in fast memory~800 tok/sollama run lfm2.5-thinking:1.2b-q8_0
2x DGX Spark 128GBllama.cppQ8_0 GGUF1.9 GBfits in fast memory~139 tok/sllama-server -hf unsloth/LFM2.5-1.2B-Thinking-GGUF:Q8_0 --rpc node2:50052 -c 8192 # run rpc-server on each other node
4x Mac Studio M5 Max (40c GPU) 128GBllama.cppQ8_0 GGUF1.9 GBfits in fast memory~295 tok/sllama-server -hf unsloth/LFM2.5-1.2B-Thinking-GGUF:Q8_0 --rpc node2:50052,node3:50052,node4:50052 -c 8192 # run rpc-server on each other node
2x Mac Studio M5 Ultra (80c GPU) 256GBllama.cppQ8_0 GGUF1.9 GBfits in fast memory~653 tok/sllama-server -hf unsloth/LFM2.5-1.2B-Thinking-GGUF:Q8_0 --rpc node2:50052 -c 8192 # run rpc-server on each other node
Mac Studio M3 Ultra (80c GPU) 512GBOllamaQ8_01.9 GBfits in fast memory~546 tok/sollama run lfm2.5-thinking:1.2b-q8_0
4x DGX Spark 128GBllama.cppQ8_0 GGUF1.9 GBfits in fast memory~123 tok/sllama-server -hf unsloth/LFM2.5-1.2B-Thinking-GGUF:Q8_0 --rpc node2:50052,node3:50052,node4:50052 -c 8192 # run rpc-server on each other node
4x Mac Studio M5 Ultra (80c GPU) 256GBllama.cppQ8_0 GGUF1.9 GBfits in fast memory~576 tok/sllama-server -hf unsloth/LFM2.5-1.2B-Thinking-GGUF:Q8_0 --rpc node2:50052,node3:50052,node4:50052 -c 8192 # run rpc-server on each other node

Estimates, not benchmarks. Model sizes are ollama.com download sizes; memory needed adds headroom for ~8k tokens of context; speeds are rough figures from memory bandwidth. Data updated 2026-10-18.

A project by OnDevice Labs · llms.txt