Home/Glossary/GPU Cores

Hardware

What is GPU Cores?

The parallel processing units in Apple Silicon used for LLM inference via the Metal framework. More GPU cores generally means faster tok/s. The M5 Max has 40 GPU cores, the M4 Pro has 20, and the base M3 has 10. According to the LLMCheck index, GPU core count correlates with inference speed but memory bandwidth is the stronger predictor.

Where GPU Cores comes up on LLMCheck

See the best local LLMs for every Mac →

Related terms

All 37 terms in the LLMCheck glossary →