Yes: Mistral Medium 3.5 runs on 12 of 54 Macs in the LLMCheck index. It needs about 77 GB at a 4K context, 100 GB at 64K. Smallest and fastest current Mac: the Mac Studio M5 Ultra 96 GB (~13 tok/s est.); none reaches 15 tok/s. Best measured figure: 7.7 tok/s on an M5 Ultra 512 GB (published figure, FP8).
One row per Mac configuration, grouped by product line. The build is the one each speed is for; the context column is the longest prompt that fits inside macOS’s default GPU memory limit with a 16-bit KV cache (“raised” where the limit has to be raised first; “full” when the whole window fits). Speeds are decode tok/s from the LLMCheck index, each with its provenance mark. For dense models, the formula’s typical error is about 9% (the median gap to 75 measured plain-decode runs; it tends to undershoot (median −6%), and an estimate scaled from the model’s own measured run is usually closer; method).
| Mac | Verdict | Build | Speed | Max context | Model page |
|---|---|---|---|---|---|
| MacBook Air | |||||
| MacBook Air M5 16 GB | Doesn't fit | — | — | — | — |
| MacBook Air M5 24 GB | Doesn't fit | — | — | — | — |
| MacBook Air M5 32 GB | Doesn't fit | — | — | — | — |
| MacBook Air M1 8 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M4 16 GB used | Doesn't fit | — | — | — | — |
| MacBook Air M2 16 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M3 16 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M1 16 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M4 24 GB used | Doesn't fit | — | — | — | — |
| MacBook Air M2 24 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M3 24 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Pro | |||||
| MacBook Pro M6 16 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Pro 24 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M6 24 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M6 32 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Pro 48 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Max 64 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Pro 64 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Max 128 GB | Runs, slowly | Q4_K_M | estimated7 tok/s | 86K | M5 Max page |
| MacBook Pro M3 Max 64 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Pro M3 Max 128 GB refurb | Runs, slowly | Q4_K_M | estimated4 tok/s | 55K | — |
| Mac mini | |||||
| Mac mini M6 16 GB | Doesn't fit | — | — | — | — |
| Mac mini M5 Pro 24 GB | Doesn't fit | — | — | — | — |
| Mac mini M6 24 GB | Doesn't fit | — | — | — | — |
| Mac mini M6 32 GB | Doesn't fit | — | — | — | — |
| Mac mini M5 Pro 48 GB | Doesn't fit | — | — | — | — |
| Mac mini M5 Pro 64 GB | Doesn't fit | — | — | — | — |
| Mac mini M2 Pro 16 GB refurb | Doesn't fit | — | — | — | — |
| Mac mini M4 16 GB used | Doesn't fit | — | — | — | — |
| Mac mini M4 Pro 24 GB used | Doesn't fit | — | — | — | — |
| Mac mini M4 24 GB used | Doesn't fit | — | — | — | — |
| Mac mini M2 Pro 32 GB refurb | Doesn't fit | — | — | — | — |
| Mac mini M4 Pro 48 GB used | Doesn't fit | — | — | — | — |
| Mac mini M4 Pro 64 GB used | Doesn't fit | — | — | — | — |
| iMac | |||||
| iMac M6 16 GB | Doesn't fit | — | — | — | — |
| iMac M6 24 GB | Doesn't fit | — | — | — | — |
| iMac M6 32 GB | Doesn't fit | — | — | — | — |
| Mac Studio | |||||
| Mac Studio M5 Max 36 GB | Doesn't fit | — | — | — | — |
| Mac Studio M5 Max 48 GB | Doesn't fit | — | — | — | — |
| Mac Studio M5 Max 64 GB | Doesn't fit | — | — | — | — |
| Mac Studio M5 Ultra 96 GB | Runs, slowly | Q4_K_M | estimated13 tok/s | 6K | M5 Ultra page |
| Mac Studio M5 Max 128 GB | Runs, slowly | Q4_K_M | estimated7 tok/s | 86K | M5 Max page |
| Mac Studio M5 Ultra 256 GB | Runs, slowly | Q4_K_M | estimated13 tok/s | 256K (full) | M5 Ultra page |
| Mac Studio M5 Ultra 512 GB | Runs, slowly | Q4_K_M | estimated13 tok/s | 256K (full) | M5 Ultra page |
| Mac Studio M2 Max 32 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M1 Ultra 64 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M4 Max 64 GB used | Doesn't fit | — | — | — | — |
| Mac Studio M2 Max 64 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M1 Ultra 128 GB refurb | Runs, slowly | Q4_K_M | estimated9 tok/s | 55K | — |
| Mac Studio M2 Ultra 128 GB refurb | Runs, slowly | Q4_K_M | estimated9 tok/s | 55K | — |
| Mac Studio M4 Max 128 GB used | Runs, slowly | Q4_K_M | estimated6 tok/s | 55K | — |
| Mac Studio M2 Ultra 192 GB refurb | Runs, slowly | Q4_K_M | estimated9 tok/s | 185K | — |
| Mac Studio M3 Ultra 256 GB used | Runs, slowly | Q4_K_M | estimated9 tok/s | 256K (full) | M3 Ultra page |
| Mac Studio M3 Ultra 512 GB refurb | Runs, slowly | Q4_K_M | estimated9 tok/s | 256K (full) | M3 Ultra page |
Context memory is computed from its config.json (GQA on all 88 layers (8 kv heads x 128)): about 23.6 GB of 16-bit KV cache at 64K tokens. A q8 cache (llama.cpp -ctk q8_0 -ctv q8_0, Ollama OLLAMA_KV_CACHE_TYPE=q8_0) halves that part. Runtimes also grow a compute buffer with context, so a fit within about 1 GB of the limit is optimistic.
macOS lets the GPU use only part of unified memory by default. Mistral Medium 3.5 fits inside that default limit on every Mac it fits at all, so no Mac in the table needs it raised at a short context. Long contexts may still need it: the context column already uses each Mac’s default limit.
Weights are 128B parameters at each format’s effective size (the index’s GB-per-billion table), plus about 2 GB for the runtime and a short context; longer contexts add the KV cache computed from the model’s config.json at 16 bits. The first row is the catalog’s own figure (about 77 GB at a 4K context), the one every verdict on this page uses. “Smallest Mac” is the smallest memory size among the Macs Apple sells new that holds it at a 4K context inside that Mac’s default GPU limit. Estimates, not measurements.
| Build | Weights | RAM at 4K | at 32K | at 64K | Smallest Mac |
|---|---|---|---|---|---|
| As catalogued | — | 77 GB | 87 GB | 99 GB | 96 GB |
| Q2_K | 43.5 GB | 46 GB | 56 GB | 68 GB | 64 GB |
| Q3_K_M | 62.7 GB | 65 GB | 75 GB | 87 GB | 96 GB |
| Q4_K_M | 73.0 GB | 75 GB | 85 GB | 97 GB | 96 GB |
| Q5_K_M | 90.9 GB | 93 GB | 103 GB | 115 GB | 128 GB |
| Q6_K | 105.0 GB | 107 GB | 117 GB | 129 GB | 128 GB |
| Q8_0 | 135.7 GB | 138 GB | 148 GB | 160 GB | 256 GB |
| F16 | 256.0 GB | 258 GB | 268 GB | 280 GB | 512 GB |
Every published (filled square) and community (hollow circle) run the index holds for Mistral Medium 3.5: 2 published, 0 community, each linked to its source. LLMCheck runs no tests of its own. One row is one measurement session; on each chip the table above shows the lower median of the eligible runs (plain decode at 5 bits or fewer), and a binned or “not an anchor” run is shown but never used as a reference.
| Chip | Runtime | Quant | Decode | Context | Date | Source |
|---|---|---|---|---|---|---|
| M5 Ultra | MLX | FP8 | sourced7.7 tok/s | 8,192-token context, 128 generated | 2026-10-15 | machinelearning.apple.com |
| M3 Ultra | MLX | FP8 | sourced4.95 tok/s | 8,192-token context, 128 generated | 2026-10-15 | machinelearning.apple.com |
The quickest start is Ollama. Pull the model by its tag (checked on ollama.com, 2026-11-14; the file is about 80 GB):
Prefer a window to a terminal? LM Studio downloads the same model with one click. · model card →
On the Mac Studio M5 Ultra (96 GB), the smallest current Mac that runs it inside the default GPU limit, the index figure is ~13 tok/s (estimated) at Q4_K_M; keep the context at or under 6K there, or use a q8 KV cache. The mistral-medium-3.5:128b file fits there.
Step-by-step: the Ollama install guide.
Mac Studio M5 Ultra (96 GB) — smallest current Mac that runs it, $5,499 new (Apple list price, checked 2026-11-14), ~13 tok/s (estimated). Amazon does not stock the Mac Studio M5 Ultra (96 GB): Apple builds it to order.
Yes. Mistral Medium 3.5 needs about 77 GB of unified memory at a short (4K-token) context, so it runs on 12 of the 54 Mac configurations in the LLMCheck index. The smallest Mac Apple sells new that runs it is the Mac Studio M5 Ultra (96 GB).
About 77 GB at a 4K context: the weights plus about 2 GB for the runtime. Context adds KV cache: about 88 GB in total at 32K and 100 GB at 64K with the default 16-bit cache (about 89 GB at 64K with a q8 cache). These are estimates from the model’s config.json, not measurements.
On an M5 Max, the chip the leaderboard quotes it on, the index figure is ~7 tok/s (estimated) at Q4_K_M. The best measured figure is 7.7 tok/s on an M5 Ultra 512 GB (published figure, FP8). Every Mac’s figure is in the table on this page with its provenance: published, community run or estimated.
No Mac Apple sells new reaches 15 tok/s with Mistral Medium 3.5. The fastest is the Mac Studio M5 Ultra (96 GB) at ~13 tok/s (estimated): fine for batch work, slow for chat.
No. On all 12 Mac configurations where Mistral Medium 3.5 fits, it fits inside that Mac’s default GPU memory limit at a short context; only a long context on the smallest of them can push it over.
Q4_K_M (about 73 GB of weights) is the common 4-bit GGUF choice. Q8_0 (about 136 GB) is closer to full quality and needs a 256 GB Mac at the default GPU limit. Q3_K_M and Q2_K shrink it to about 63 and 44 GB at a quality cost. The index’s reference figure (7 tok/s on an M5 Max) is for its Q4_K_M build.
Its own window is 256K tokens. At macOS’s default GPU limit, the Mac Studio M5 Ultra (96 GB) holds about 6K. The full window needs about 171 GB, which a 256 GB Mac holds at the default limit. A q8 KV cache roughly doubles these lengths.
LLMCheck. (2026). Can I run Mistral Medium 3.5 on a Mac? llmcheck.net. https://llmcheck.net/can-i-run/mistral-medium-35/ (updated ). CC BY 4.0.