The best local LLM for a Mac mini M4 Pro (24 GB) is Qwen 3.6-27B at 18 tok/s. With 24 GB of unified memory it runs 42 of the models we benchmark — from compact options up to 35B-class models. For everyday chat and coding, Qwen 3.6-27B is the sweet spot. Full ranking below.
Ranked by LLMCheck suitability (capability balanced against speed on the M4 Pro). Click a model for its full benchmark and setup. All speeds are index estimates (memory-bandwidth model, cross-referenced with sourced benchmarks where available) — submit a real run →
| # | Model | Size | License | Speed | Capability |
|---|---|---|---|---|---|
| 1 | Qwen 3.6-27B | 27B | Apache 2.0 | 18 tok/s | 44/50 |
| 2 | Muse Glimmer 30B | 30B | Apache 2.0 | 10 tok/s | 42/50 |
| 3 | KAT-Coder-V2.5 | 35B | Apache 2.0 | 24 tok/s | 39/50 |
| 4 | Qwen 3.6-35B-A3B | 35B | Apache 2.0 | 32 tok/s | 38/50 |
| 5 | Gemma 4 31B | 31B | Apache 2.0 | 14 tok/s | 40/50 |
| 6 | Nemotron 3.5 Lightning | 30B | OpenMDW | 28 tok/s | 36/50 |
| 7 | Gemma 4 26B-A4B | 26B | Apache 2.0 | 28 tok/s | 35/50 |
| 8 | GLM-4.7-Flash | 31B | MIT | 16 tok/s | 35/50 |
| 9 | Laguna XS 2.1 | 33B | OpenMDW | 25 tok/s | 33/50 |
| 10 | Bonsai 27B | 27B | Apache 2.0 | 18 tok/s est. | 33/50 |
| 11 | Maple Preview 20B-A1B | 20B | MIT | 127 tok/s est. | 20/50 |
| 12 | Nemotron-Cascade 2 | 30B | NVIDIA Open | 22 tok/s | 30/50 |
Showing the top 12 of 42 models that fit in 24 GB. See the full leaderboard or all benchmarks.
The fastest way to get started is Ollama. Install it, then pull the top pick for your Mac:
Prefer a GUI? LM Studio gives you a one-click download and chat window. For step-by-step help see our Ollama install guide, or open the Qwen 3.6-27B on M4 Pro benchmark page for exact settings.
The Mac mini M4 Pro (24 GB) comfortably runs 42 of the models we benchmark, led by Qwen 3.6-27B. Grab one and start running LLMs offline today:
As an Amazon Associate, LLMCheck earns from qualifying purchases. Affiliate links cost you nothing extra and never influence our rankings.
Qwen 3.6-27B (27B, Apache 2.0) is the best all-round pick at 18 tok/s on the M4 Pro. If you want maximum speed, Maple Preview 20B-A1B hits 127 tok/s; for maximum capability, Muse Glimmer 30B still fits in 24 GB.
About 42 of the 80 models in the LLMCheck leaderboard fit in 24 GB of unified memory, from compact models up to KAT-Coder-V2.5 (35B).
Not comfortably. A 70B model in Q4 needs ~40–44 GB; with 24 GB you should stick to models up to ~18 GB, such as Qwen 3.6-27B. For 70B, look at a 48 GB+ Mac.
24 GB is great for small-to-mid models (up to ~14B comfortably); for 30B+ you'll want 32 GB or more. Because Apple Silicon uses unified memory, that figure is both your system RAM and your VRAM.