Can I run Llama 3.1 405B on a Mac?

Yes: Llama 3.1 405B runs on 4 of 54 Macs in the LLMCheck index. It needs about 240 GB at a 4K context. The smallest current Mac that runs it, the Mac Studio M5 Ultra 256 GB (with a raised GPU limit), is also the fastest, at ~4 tok/s est.: no current Mac reaches 15 tok/s. No measured run yet.

RAM at 4K
240
GB
RAM at 64K
—
no KV figure
Macs that run it
4
of 54 configs
Best measured
—
no measured run

Llama 3.1 405B on every Mac

One row per Mac configuration, grouped by product line. The build is the one each speed is for; the context column is the longest prompt that fits inside macOS’s default GPU memory limit with a 16-bit KV cache (“raised” where the limit has to be raised first; “full” when the whole window fits). Speeds are decode tok/s from the LLMCheck index, each with its provenance mark. For dense models, the formula’s typical error is about 9% (the median gap to 75 measured plain-decode runs; it tends to undershoot (median −6%), and an estimate scaled from the model’s own measured run is usually closer; method).

Runs fits macOS’s default GPU limit, 15+ tok/sRuns, slowly fits, under 15 tok/sRaise GPU limit fits once the limit is raised (command below)Doesn't fit needs more memory than the Mac has
MacVerdictBuildSpeedMax contextModel page
MacBook Air
MacBook Air M5 16 GBDoesn't fit————
MacBook Air M5 24 GBDoesn't fit————
MacBook Air M5 32 GBDoesn't fit————
MacBook Air M1 8 GB refurbDoesn't fit————
MacBook Air M4 16 GB usedDoesn't fit————
MacBook Air M2 16 GB refurbDoesn't fit————
MacBook Air M3 16 GB refurbDoesn't fit————
MacBook Air M1 16 GB refurbDoesn't fit————
MacBook Air M4 24 GB usedDoesn't fit————
MacBook Air M2 24 GB refurbDoesn't fit————
MacBook Air M3 24 GB refurbDoesn't fit————
MacBook Pro
MacBook Pro M6 16 GBDoesn't fit————
MacBook Pro M5 Pro 24 GBDoesn't fit————
MacBook Pro M6 24 GBDoesn't fit————
MacBook Pro M6 32 GBDoesn't fit————
MacBook Pro M5 Pro 48 GBDoesn't fit————
MacBook Pro M5 Max 64 GBDoesn't fit————
MacBook Pro M5 Pro 64 GBDoesn't fit————
MacBook Pro M5 Max 128 GBDoesn't fit————
MacBook Pro M3 Max 64 GB refurbDoesn't fit————
MacBook Pro M3 Max 128 GB refurbDoesn't fit————
Mac mini
Mac mini M6 16 GBDoesn't fit————
Mac mini M5 Pro 24 GBDoesn't fit————
Mac mini M6 24 GBDoesn't fit————
Mac mini M6 32 GBDoesn't fit————
Mac mini M5 Pro 48 GBDoesn't fit————
Mac mini M5 Pro 64 GBDoesn't fit————
Mac mini M2 Pro 16 GB refurbDoesn't fit————
Mac mini M4 16 GB usedDoesn't fit————
Mac mini M4 Pro 24 GB usedDoesn't fit————
Mac mini M4 24 GB usedDoesn't fit————
Mac mini M2 Pro 32 GB refurbDoesn't fit————
Mac mini M4 Pro 48 GB usedDoesn't fit————
Mac mini M4 Pro 64 GB usedDoesn't fit————
iMac
iMac M6 16 GBDoesn't fit————
iMac M6 24 GBDoesn't fit————
iMac M6 32 GBDoesn't fit————
Mac Studio
Mac Studio M5 Max 36 GBDoesn't fit————
Mac Studio M5 Max 48 GBDoesn't fit————
Mac Studio M5 Max 64 GBDoesn't fit————
Mac Studio M5 Ultra 96 GBDoesn't fit————
Mac Studio M5 Max 128 GBDoesn't fit————
Mac Studio M5 Ultra 256 GBRaise GPU limit command ↓Q4_K_Mestimated4 tok/s—M5 Ultra page
Mac Studio M5 Ultra 512 GBRuns, slowlyQ4_K_Mestimated4 tok/s—M5 Ultra page
Mac Studio M2 Max 32 GB refurbDoesn't fit————
Mac Studio M1 Ultra 64 GB refurbDoesn't fit————
Mac Studio M4 Max 64 GB usedDoesn't fit————
Mac Studio M2 Max 64 GB refurbDoesn't fit————
Mac Studio M1 Ultra 128 GB refurbDoesn't fit————
Mac Studio M2 Ultra 128 GB refurbDoesn't fit————
Mac Studio M4 Max 128 GB usedDoesn't fit————
Mac Studio M2 Ultra 192 GB refurbDoesn't fit————
Mac Studio M3 Ultra 256 GB usedRaise GPU limit command ↓Q4_K_Mestimated3 tok/s——
Mac Studio M3 Ultra 512 GB refurbRuns, slowlyQ4_K_Mestimated3 tok/s——
Provenance key
sourced
Published figure — vendor or press review
estimated
community
Linked individual run — blog, forum or submission

The index has no KV-cache figure for Llama 3.1 405B yet, so the context column shows —: its minimum RAM covers a short (about 4K-token) prompt only.

Raising the GPU memory limit

macOS lets the GPU wire only part of unified memory by default (Metal’s recommended working set; M5 and M6 Macs run macOS 26 or later, whose default is higher), and Llama 3.1 405B needs about 240 GB. On the Macs marked Raise GPU limit it fits in RAM but not inside that default. The default is a performance threshold, not a hard wall: past it, the runtime moves part of it to the CPU or shortens the context (llama.cpp, Ollama), runs it slowly (MLX), or stops with an out-of-memory error. One command raises the limit until the next restart (sudo sysctl iogpu.wired_limit_mb=0 restores the default sooner); it leaves macOS a reserve, and other apps get less memory while the model is loaded.

Llama 3.1 405B: memory by quantization

Weights are 405B parameters at each format’s effective size (the index’s GB-per-billion table), plus about 2 GB for the runtime and a short context; longer contexts add the KV cache computed from the model’s config.json at 16 bits. The first row is the catalog’s own figure (about 240 GB at a 4K context), the one every verdict on this page uses. “Smallest Mac” is the smallest memory size among the Macs Apple sells new that holds it at a 4K context inside that Mac’s default GPU limit. Estimates, not measurements.

BuildWeightsRAM at 4Kat 32Kat 64KSmallest Mac
As catalogued—240 GB——512 GB (256 GB with a raised limit)
Q2_K137.7 GB140 GB——256 GB
Q3_K_M198.4 GB200 GB——256 GB
Q4_K_M230.8 GB233 GB——512 GB (256 GB with a raised limit)
Q5_K_M287.6 GB290 GB——512 GB
Q6_K332.1 GB334 GB——512 GB
Q8_0429.3 GB431 GB——512 GB
F16810.0 GB812 GB——none (over 512 GB)

Measured runs

The index holds no published or community run of Llama 3.1 405B yet, so every speed on this page is an estimate from the memory-bandwidth model. LLMCheck runs no tests of its own: if you have run it on a Mac, submit the figure with its setup →

Recommended setup

The quickest start is Ollama. Pull the model by its tag (checked on ollama.com, 2026-11-14; the file is about 243 GB):

ollama run llama3.1:405b

Prefer a window to a terminal? LM Studio downloads the same model with one click. · model card →

On the Mac Studio M5 Ultra (512 GB), the smallest current Mac that runs it inside the default GPU limit, the index figure is ~4 tok/s (estimated) at Q4_K_M; keep the context at or under a short prompt there, or use a q8 KV cache. The llama3.1:405b file fits there.

Step-by-step: the Ollama install guide.

🛒 Which Mac to get for Llama 3.1 405B

Mac Studio M5 Ultra (256 GB) — smallest current Mac that runs it, $9,499 new (Apple list price, checked 2026-11-14), ~4 tok/s (estimated) once the GPU memory limit is raised. For Ollama: the llama3.1:405b tag is about 243 GB, so it needs a 512 GB Mac; on 256 GB use a ~5-bit build after raising the GPU limit. Amazon does not stock the Mac Studio M5 Ultra (256 GB): Apple builds it to order.

FAQ: Llama 3.1 405B on a Mac

Can I run Llama 3.1 405B on a Mac?

Yes. Llama 3.1 405B needs about 240 GB of unified memory at a short (4K-token) context, so it runs on 4 of the 54 Mac configurations in the LLMCheck index; 2 of them hold it inside macOS’s default GPU memory limit and 2 only after raising that limit. The smallest Mac Apple sells new that runs it is the Mac Studio M5 Ultra (256 GB).

How much RAM does Llama 3.1 405B need?

About 240 GB at a short (about 4K-token) context: the weights plus about 2 GB for the runtime. The index has no KV-cache figure for Llama 3.1 405B yet, so it cannot say how much a long context adds.

How fast does Llama 3.1 405B run on a Mac?

On an M5 Ultra, the chip the leaderboard quotes it on, the index figure is ~4 tok/s (estimated) at Q4_K_M. No published or community run is in the index yet; every speed is an estimate from the memory-bandwidth model. Every Mac’s figure is in the table on this page with its provenance: published, community run or estimated.

What is the cheapest Mac that runs Llama 3.1 405B well?

No Mac Apple sells new reaches 15 tok/s with Llama 3.1 405B. The fastest is the Mac Studio M5 Ultra (256 GB) at ~4 tok/s (estimated): fine for batch work, slow for chat.

Do I need to raise the GPU memory limit to run Llama 3.1 405B?

On 2 of the 54 configurations, yes: Mac Studio M5 Ultra 256 GB, Mac Studio M3 Ultra 256 GB (used). macOS lets the GPU use only part of unified memory by default (about 223 GB on the Mac Studio M5 Ultra (256 GB)), and Llama 3.1 405B needs about 240 GB. Running sudo sysctl iogpu.wired_limit_mb=245760 in Terminal raises the limit on a 256 GB Mac until the next restart. From 512 GB up, every Mac Apple sells new holds it inside the default limit.

Which quantization of Llama 3.1 405B should I use?

Q4_K_M (about 231 GB of weights) is the common 4-bit GGUF choice. Q8_0 (about 429 GB) is closer to full quality and needs a 512 GB Mac at the default GPU limit. Q3_K_M and Q2_K shrink it to about 198 and 138 GB at a quality cost. The index’s reference figure (4 tok/s on an M5 Ultra) is for its Q4_K_M build.

Cite this page

LLMCheck. (2026). Can I run Llama 3.1 405B on a Mac? llmcheck.net. https://llmcheck.net/can-i-run/llama-31-405b/ (updated ). CC BY 4.0.

How to cite LLMCheck →Data: CC BY 4.0Markdown version

Related

Figures from the LLMCheck index, data version 2026-11-18. Verdicts and context limits are estimates from each model’s catalog memory figure and config.json.