← CanIRunLocal · All hardware · All models

Can I run EmbeddingGemma 2 270M locally?

Google · 0.27B parameters · embedding.

Ollama weight files: Default 0.38 GB (embeddinggemma-2:270m).

Yes on 56 machines in this list. The smallest is M1 8GB: Default, about 1 GB, roughly 143 tokens per second, via Ollama. ollama pull embeddinggemma-2:270m

Setup on DGX Spark 128GB (NVIDIA, ASUS, Dell, Lenovo, HP, MSI, Acer, Gigabyte)

Open EmbeddingGemma 2 270M in the checker

Hardware that fits

HardwareRuntimeQuantMemoryFitSpeedCommand
M1 8GBOllamaDefault1 GBfits in fast memory~143 tok/sollama pull embeddinggemma-2:270m
M2 8GBOllamaDefault1 GBfits in fast memory~211 tok/sollama pull embeddinggemma-2:270m
M3 8GBOllamaDefault1 GBfits in fast memory~211 tok/sollama pull embeddinggemma-2:270m
RTX 3060 Ti 8GBOllamaDefault1 GBfits in fast memory~707 tok/sollama pull embeddinggemma-2:270m
RTX 3070 8GBOllamaDefault1 GBfits in fast memory~707 tok/sollama pull embeddinggemma-2:270m
RTX 4060 8GBOllamaDefault1 GBfits in fast memory~429 tok/sollama pull embeddinggemma-2:270m
RX 7600 8GBOllamaDefault1 GBfits in fast memory~455 tok/sollama pull embeddinggemma-2:270m
RTX 3080 10GBOllamaDefault1 GBfits in fast memory~1200 tok/sollama pull embeddinggemma-2:270m
M1 16GBOllamaDefault1 GBfits in fast memory~143 tok/sollama pull embeddinggemma-2:270m
M2 16GBOllamaDefault1 GBfits in fast memory~211 tok/sollama pull embeddinggemma-2:270m
M3 16GBOllamaDefault1 GBfits in fast memory~211 tok/sollama pull embeddinggemma-2:270m
M4 16GBOllamaDefault1 GBfits in fast memory~253 tok/sollama pull embeddinggemma-2:270m
RTX 3060 12GBOllamaDefault1 GBfits in fast memory~568 tok/sollama pull embeddinggemma-2:270m
RTX 4070 12GBOllamaDefault1 GBfits in fast memory~796 tok/sollama pull embeddinggemma-2:270m
RTX 5070 12GBOllamaDefault1 GBfits in fast memory~1061 tok/sollama pull embeddinggemma-2:270m
RTX 4060 Ti 16GBOllamaDefault1 GBfits in fast memory~455 tok/sollama pull embeddinggemma-2:270m
RTX 4070 Ti Super 16GBOllamaDefault1 GBfits in fast memory~1061 tok/sollama pull embeddinggemma-2:270m
RTX 4080 16GBOllamaDefault1 GBfits in fast memory~1132 tok/sollama pull embeddinggemma-2:270m
RTX 5080 16GBOllamaDefault1 GBfits in fast memory~1516 tok/sollama pull embeddinggemma-2:270m
RX 7800 XT 16GBOllamaDefault1 GBfits in fast memory~985 tok/sollama pull embeddinggemma-2:270m
RX 9070 XT 16GBOllamaDefault1 GBfits in fast memory~1011 tok/sollama pull embeddinggemma-2:270m
M2 24GBOllamaDefault1 GBfits in fast memory~211 tok/sollama pull embeddinggemma-2:270m
M3 24GBOllamaDefault1 GBfits in fast memory~211 tok/sollama pull embeddinggemma-2:270m
M4 24GBOllamaDefault1 GBfits in fast memory~253 tok/sollama pull embeddinggemma-2:270m
RTX 3090 24GBOllamaDefault1 GBfits in fast memory~1478 tok/sollama pull embeddinggemma-2:270m
RTX 4090 24GBOllamaDefault1 GBfits in fast memory~1592 tok/sollama pull embeddinggemma-2:270m
RX 7900 XTX 24GBOllamaDefault1 GBfits in fast memory~1516 tok/sollama pull embeddinggemma-2:270m
M1 Pro 32GBOllamaDefault1 GBfits in fast memory~421 tok/sollama pull embeddinggemma-2:270m
M2 Pro 32GBOllamaDefault1 GBfits in fast memory~421 tok/sollama pull embeddinggemma-2:270m
M4 32GBOllamaDefault1 GBfits in fast memory~253 tok/sollama pull embeddinggemma-2:270m
M3 Pro 36GBOllamaDefault1 GBfits in fast memory~316 tok/sollama pull embeddinggemma-2:270m
Mac Studio M4 Max (32c GPU) 36GBOllamaDefault1 GBfits in fast memory~863 tok/sollama pull embeddinggemma-2:270m
Mac Studio M5 Max (32c GPU) 36GBOllamaDefault1 GBfits in fast memory~968 tok/sollama pull embeddinggemma-2:270m
RTX 5090 32GBOllamaDefault1 GBfits in fast memory~2829 tok/sollama pull embeddinggemma-2:270m
M4 Pro 48GBOllamaDefault1 GBfits in fast memory~575 tok/sollama pull embeddinggemma-2:270m
Mac Studio M4 Max (40c GPU) 48GBOllamaDefault1 GBfits in fast memory~1149 tok/sollama pull embeddinggemma-2:270m
Mac Studio M5 Max (40c GPU) 48GBOllamaDefault1 GBfits in fast memory~1293 tok/sollama pull embeddinggemma-2:270m
M1 Max 64GBOllamaDefault1 GBfits in fast memory~842 tok/sollama pull embeddinggemma-2:270m
M2 Max 64GBOllamaDefault1 GBfits in fast memory~842 tok/sollama pull embeddinggemma-2:270m
M3 Max 64GBOllamaDefault1 GBfits in fast memory~842 tok/sollama pull embeddinggemma-2:270m
M4 Max 64GBOllamaDefault1 GBfits in fast memory~1149 tok/sollama pull embeddinggemma-2:270m
Mac Studio M4 Max (40c GPU) 64GBOllamaDefault1 GBfits in fast memory~1149 tok/sollama pull embeddinggemma-2:270m
Mac Studio M5 Max (40c GPU) 64GBOllamaDefault1 GBfits in fast memory~1293 tok/sollama pull embeddinggemma-2:270m
DGX Spark 64GB (ASUS, Dell, HP, MSI, Acer, Gigabyte)OllamaDefault1 GBfits in fast memory~539 tok/sollama pull embeddinggemma-2:270m
Mac Studio M3 Ultra 96GBOllamaDefault1 GBfits in fast memory~1724 tok/sollama pull embeddinggemma-2:270m
Mac Studio M5 Ultra 96GBOllamaDefault1 GBfits in fast memory~2526 tok/sollama pull embeddinggemma-2:270m
M3 Max 128GBOllamaDefault1 GBfits in fast memory~842 tok/sollama pull embeddinggemma-2:270m
M4 Max 128GBOllamaDefault1 GBfits in fast memory~1149 tok/sollama pull embeddinggemma-2:270m
Mac Studio M4 Max (40c GPU) 128GBOllamaDefault1 GBfits in fast memory~1149 tok/sollama pull embeddinggemma-2:270m
Mac Studio M5 Max (40c GPU) 128GBOllamaDefault1 GBfits in fast memory~1293 tok/sollama pull embeddinggemma-2:270m
DGX Spark 128GB (NVIDIA, ASUS, Dell, Lenovo, HP, MSI, Acer, Gigabyte)OllamaDefault1 GBfits in fast memory~539 tok/sollama pull embeddinggemma-2:270m
M2 Ultra 192GBOllamaDefault1 GBfits in fast memory~1684 tok/sollama pull embeddinggemma-2:270m
Mac Studio M3 Ultra 256GBOllamaDefault1 GBfits in fast memory~1724 tok/sollama pull embeddinggemma-2:270m
Mac Studio M5 Ultra (64c GPU) 256GBOllamaDefault1 GBfits in fast memory~2526 tok/sollama pull embeddinggemma-2:270m
Mac Studio M5 Ultra (80c GPU) 256GBOllamaDefault1 GBfits in fast memory~2526 tok/sollama pull embeddinggemma-2:270m
Mac Studio M3 Ultra (80c GPU) 512GBOllamaDefault1 GBfits in fast memory~1724 tok/sollama pull embeddinggemma-2:270m

Estimates, not benchmarks. Model sizes are ollama.com download sizes; memory needed adds headroom for ~8k tokens of context; speeds are rough figures from memory bandwidth. Data updated 2026-10-16.

A project by OnDevice Labs · llms.txt