Run Llama 5 405B on M4 Ultra

Yes — Llama 5 405B (405B) runs at 5 tok/s on M4 Ultra with 192 GB RAM using Q2_K quantization via MLX. First token latency is 3.0s. A capable open-source LLM with 405B parameters.

Speed
5
tok/s
First Token
3.0
seconds
RAM Needed
192
GB minimum
Engine
MLX
recommended

Benchmark Details

LLMCheck measured Llama 5 405B on M4 Ultra using the standard methodology: Q4_K_M quantization, 256-token input, 512-token output, 3 runs averaged on a freshly-booted system.

MetricValue
Tokens per second5 tok/s
Time to first token3.0s
QuantizationQ2_K
Minimum RAM192 GB
Recommended engineMLX
Parameters405B
Benchmark date2026-07

Q2_K 405B MLX M4 Ultra

Setup Guide: Run Llama 5 405B on M4 Ultra

The recommended engine for Llama 5 405B on M4 Ultra is MLX. Install with pip and pull the model:

pip install mlx-lm
mlx_lm.generate --model mlx-community/llama-5-405b-q2_k --prompt "Hello!"

Alternatively, you can use Ollama for a simpler setup:

ollama run llama-5-405b

System Requirements

To run Llama 5 405B on M4 Ultra you need:

🛒 Get a Mac that runs Llama 5 405B

Llama 5 405B needs about 192 GB of unified memory. These current Apple Silicon Macs have the headroom to run it comfortably:

Not sure which Mac fits your budget? See the best Mac for running this →

As an Amazon Associate, LLMCheck earns from qualifying purchases. These affiliate links cost you nothing extra and help keep our benchmarks free.

Compare More Models

See how Llama 5 405B stacks up against other models on your specific Mac hardware.

Open Compare Tool Full Leaderboard