Home/Glossary/Memory Bandwidth

Hardware

What is Memory Bandwidth?

The rate at which data moves between memory and processor, measured in GB/s. LLMCheck defines memory bandwidth as the single most important hardware spec for local AI speed on Mac. During inference, the entire model is read from memory for every token. According to the LLMCheck index: M5 Max delivers ~600 GB/s, M4 Max ~546 GB/s, M4 Pro ~273 GB/s, base M3 ~200 GB/s. Higher bandwidth = faster tok/s.

Where Memory Bandwidth comes up on LLMCheck

See the best local LLMs for every Mac →

Related terms

All 37 terms in the LLMCheck glossary →