Best Local LLMs for the MacBook Air M2 (24 GB)

The best local LLM for a MacBook Air M2 (24 GB) is Qwen 3.6-27B at 7 tok/s. With 24 GB of unified memory it runs 42 of the models we benchmark — from compact options up to 35B-class models. For everyday chat and coding, Qwen 3.6-27B is the sweet spot. Full ranking below.

Unified memory
24
GB
Mem. bandwidth
100
GB/s
Models that fit
42
of 80
Top speed
78
tok/s

Top 3 picks for the MacBook Air M2 (24 GB)

⭐ Best overall
27B · Apache 2.0 · cap 44/50
7 tok/s
⚡ Fastest
3B · Apache 2.0 · cap 10/50
78 tok/s
🧠 Runner-up
30B · Apache 2.0 · cap 42/50
4 tok/s

Every model ranked for a MacBook Air M2 (24 GB)

Ranked by LLMCheck suitability (capability balanced against speed on the M2). Click a model for its full benchmark and setup. All speeds are index estimates (memory-bandwidth model, cross-referenced with sourced benchmarks where available) — submit a real run →

#ModelSizeLicenseSpeedCapability
1Qwen 3.6-27B27BApache 2.07 tok/s est.44/50
2Muse Glimmer 30B30BApache 2.04 tok/s est.42/50
3Gemma 4 31B31BApache 2.04 tok/s est.40/50
4KAT-Coder-V2.535BApache 2.09 tok/s est.39/50
5Qwen 3.6-35B-A3B35BApache 2.09 tok/s est.38/50
6Nemotron 3.5 Lightning30BOpenMDW10 tok/s est.36/50
7Gemma 4 26B-A4B26BApache 2.08 tok/s est.35/50
8GLM-4.7-Flash31BMIT6 tok/s est.35/50
9Bonsai 27B27BApache 2.012 tok/s33/50
10Laguna XS 2.133BOpenMDW9 tok/s est.33/50
11Nemotron-Cascade 230BNVIDIA Open10 tok/s est.30/50
12Nanbeige4.2-3B3BApache 2.068 tok/s20/50

Showing the top 12 of 42 models that fit in 24 GB. See the full leaderboard or all benchmarks.

Quick start: run Qwen 3.6-27B on your MacBook Air M2

The fastest way to get started is Ollama. Install it, then pull the top pick for your Mac:

brew install ollama
ollama run qwen-36-27b

Prefer a GUI? LM Studio gives you a one-click download and chat window. For step-by-step help see our Ollama install guide, or open the Qwen 3.6-27B on M2 benchmark page for exact settings.

🛒 Ready to run bigger models than the MacBook Air M2 can handle?

The MacBook Air M2 (24 GB) tops out at KAT-Coder-V2.5. Newer Apple Silicon with more unified memory runs larger, smarter models much faster:

As an Amazon Associate, LLMCheck earns from qualifying purchases. Affiliate links cost you nothing extra and never influence our rankings.

FAQ: local LLMs on the MacBook Air M2

What is the best local LLM for a MacBook Air M2 (24 GB)?

Qwen 3.6-27B (27B, Apache 2.0) is the best all-round pick at 7 tok/s on the M2. If you want maximum speed, SmolLM3 3B hits 78 tok/s; for maximum capability, Muse Glimmer 30B still fits in 24 GB.

How many models can a MacBook Air M2 with 24 GB run?

About 42 of the 80 models in the LLMCheck leaderboard fit in 24 GB of unified memory, from compact models up to KAT-Coder-V2.5 (35B).

Can a MacBook Air M2 run a 70B model?

Not comfortably. A 70B model in Q4 needs ~40–44 GB; with 24 GB you should stick to models up to ~18 GB, such as Qwen 3.6-27B. For 70B, look at a 48 GB+ Mac.

Is 24 GB of RAM enough to run LLMs locally?

24 GB is great for small-to-mid models (up to ~14B comfortably); for 30B+ you'll want 32 GB or more. Because Apple Silicon uses unified memory, that figure is both your system RAM and your VRAM.

Related