On memory, yes: Inkling 2 Small fits 4 of 54 Macs in the LLMCheck index (runtime caveat below). It needs about 228 GB at a 4K context, 231 GB at 64K. Smallest and cheapest current Mac at 15+ tok/s is the Mac Studio M5 Ultra 256 GB ($9,499; ~36 tok/s est.), raised GPU limit. No measured run yet.
Runs on llama.cpp b12406+ (PR #32217) and oMLX 0.8.0 (18 Nov 2026, PR #5229), but no plain-decode Mac run on a released runtime is in the index yet; stock mlx-lm cannot load it (#2061).
One row per Mac configuration, grouped by product line. The build is the one each speed is for; the context column is the longest prompt that fits inside macOS’s default GPU memory limit with a 16-bit KV cache (“raised” where the limit has to be raised first; “full” when the whole window fits). Speeds are decode tok/s from the LLMCheck index, each with its provenance mark. For large mixture-of-experts models (over 40B total), the formula’s typical error is about 34% (the median gap to 70 measured plain-decode runs; it tends to undershoot (median −33%), and an estimate scaled from the model’s own measured run is usually closer; method).
| Mac | Verdict | Build | Speed | Max context | Model page |
|---|---|---|---|---|---|
| MacBook Air | |||||
| MacBook Air M5 16 GB | Doesn't fit | — | — | — | — |
| MacBook Air M5 24 GB | Doesn't fit | — | — | — | — |
| MacBook Air M5 32 GB | Doesn't fit | — | — | — | — |
| MacBook Air M1 8 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M4 16 GB used | Doesn't fit | — | — | — | — |
| MacBook Air M2 16 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M3 16 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M1 16 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M4 24 GB used | Doesn't fit | — | — | — | — |
| MacBook Air M2 24 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Air M3 24 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Pro | |||||
| MacBook Pro M6 16 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Pro 24 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M6 24 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M6 32 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Pro 48 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Max 64 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Pro 64 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M5 Max 128 GB | Doesn't fit | — | — | — | — |
| MacBook Pro M3 Max 64 GB refurb | Doesn't fit | — | — | — | — |
| MacBook Pro M3 Max 128 GB refurb | Doesn't fit | — | — | — | — |
| Mac mini | |||||
| Mac mini M6 16 GB | Doesn't fit | — | — | — | — |
| Mac mini M5 Pro 24 GB | Doesn't fit | — | — | — | — |
| Mac mini M6 24 GB | Doesn't fit | — | — | — | — |
| Mac mini M6 32 GB | Doesn't fit | — | — | — | — |
| Mac mini M5 Pro 48 GB | Doesn't fit | — | — | — | — |
| Mac mini M5 Pro 64 GB | Doesn't fit | — | — | — | — |
| Mac mini M2 Pro 16 GB refurb | Doesn't fit | — | — | — | — |
| Mac mini M4 16 GB used | Doesn't fit | — | — | — | — |
| Mac mini M4 Pro 24 GB used | Doesn't fit | — | — | — | — |
| Mac mini M4 24 GB used | Doesn't fit | — | — | — | — |
| Mac mini M2 Pro 32 GB refurb | Doesn't fit | — | — | — | — |
| Mac mini M4 Pro 48 GB used | Doesn't fit | — | — | — | — |
| Mac mini M4 Pro 64 GB used | Doesn't fit | — | — | — | — |
| iMac | |||||
| iMac M6 16 GB | Doesn't fit | — | — | — | — |
| iMac M6 24 GB | Doesn't fit | — | — | — | — |
| iMac M6 32 GB | Doesn't fit | — | — | — | — |
| Mac Studio | |||||
| Mac Studio M5 Max 36 GB | Doesn't fit | — | — | — | — |
| Mac Studio M5 Max 48 GB | Doesn't fit | — | — | — | — |
| Mac Studio M5 Max 64 GB | Doesn't fit | — | — | — | — |
| Mac Studio M5 Ultra 96 GB | Doesn't fit | — | — | — | — |
| Mac Studio M5 Max 128 GB | Doesn't fit | — | — | — | — |
| Mac Studio M5 Ultra 256 GB | Raise GPU limit command ↓ | Q4_K_M | estimated36 tok/s | M5 Ultra page | |
| Mac Studio M5 Ultra 512 GB | Runs | Q4_K_M | estimated36 tok/s | 1M (full) | M5 Ultra page |
| Mac Studio M2 Max 32 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M1 Ultra 64 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M4 Max 64 GB used | Doesn't fit | — | — | — | — |
| Mac Studio M2 Max 64 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M1 Ultra 128 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M2 Ultra 128 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M4 Max 128 GB used | Doesn't fit | — | — | — | — |
| Mac Studio M2 Ultra 192 GB refurb | Doesn't fit | — | — | — | — |
| Mac Studio M3 Ultra 256 GB used | Raise GPU limit command ↓ | 3.2 bpw | estimated36 tok/s | — | |
| Mac Studio M3 Ultra 512 GB refurb | Runs | Q4_K_M | estimated25 tok/s | 1M (full) | — |
Context memory is computed from its config.json (8 global layers + 40 sliding-window layers (window 1024); short-conv state constant): about 2.3 GB of 16-bit KV cache at 64K tokens. A q8 cache (llama.cpp -ctk q8_0 -ctv q8_0, Ollama OLLAMA_KV_CACHE_TYPE=q8_0) halves that part. Runtimes also grow a compute buffer with context, so a fit within about 1 GB of the limit is optimistic.
macOS lets the GPU wire only part of unified memory by default (Metal’s recommended working set; M5 and M6
Macs run macOS 26 or later, whose default is higher), and Inkling 2 Small needs about 228 GB. On the Macs marked
Raise GPU limit it fits in RAM but not inside that default. The default
is a performance threshold, not a hard wall: past it, the runtime moves part of it to the CPU or shortens the context (llama.cpp, Ollama), runs it slowly (MLX), or stops with an out-of-memory error. One command raises the limit until the next restart
(sudo sysctl iogpu.wired_limit_mb=0 restores the default sooner); it leaves macOS a reserve, and other
apps get less memory while the model is loaded.
sudo sysctl iogpu.wired_limit_mb=245760sudo sysctl iogpu.wired_limit_mb=245760Weights are 594B parameters at each format’s effective size (the index’s GB-per-billion table), plus about 2 GB for the runtime and a short context; longer contexts add the KV cache computed from the model’s config.json at 16 bits. It is a mixture-of-experts model: all 594B parameters sit in memory although only 17B are read per token. The first row is the catalog’s own figure (about 228 GB at a 4K context), the one every verdict on this page uses. “Smallest Mac” is the smallest memory size among the Macs Apple sells new that holds it at a 4K context inside that Mac’s default GPU limit. Estimates, not measurements.
| Build | Weights | RAM at 4K | at 32K | at 64K | Smallest Mac |
|---|---|---|---|---|---|
| As catalogued | — | 228 GB | 229 GB | 230 GB | 512 GB |
| Q2_K | 202.0 GB | 204 GB | 205 GB | 206 GB | 256 GB |
| Q3_K_M | 291.1 GB | 293 GB | 294 GB | 295 GB | 512 GB |
| Q4_K_M | 338.6 GB | 341 GB | 342 GB | 343 GB | 512 GB |
| Q5_K_M | 421.7 GB | 424 GB | 425 GB | 426 GB | 512 GB |
| Q6_K | 487.1 GB | 489 GB | 490 GB | 491 GB | 512 GB |
| Q8_0 | 629.6 GB | 632 GB | 633 GB | 634 GB | |
| F16 | 1188.0 GB | 1190 GB | 1191 GB | 1192 GB |
The index holds no published or community run of Inkling 2 Small yet, so every speed on this page is an estimate from the memory-bandwidth model. LLMCheck runs no tests of its own: if you have run it on a Mac, submit the figure with its setup →
Before you start: Runs on llama.cpp b12406+ (PR #32217) and oMLX 0.8.0 (18 Nov 2026, PR #5229), but no plain-decode Mac run on a released runtime is in the index yet; stock mlx-lm cannot load it (#2061).
The index has no verified Ollama tag for Inkling 2 Small. Start from its listing and copy the exact name of a build that fits: Hugging Face repo → · model card →
GGUF builds run in LM Studio or llama.cpp; MLX builds run in LM Studio or mlx-lm.
On the Mac Studio M5 Ultra (512 GB), the smallest current Mac that runs it inside the default GPU limit, the index figure is ~36 tok/s (estimated) at Q4_K_M; keep the context at or under 1M there, or use a q8 KV cache.
Step-by-step: the Ollama install guide.
Mac Studio M5 Ultra (256 GB) — smallest current Mac that runs it and cheapest at 15+ tok/s, $9,499 new (Apple list price, checked 2026-11-14), ~36 tok/s (estimated) once the GPU memory limit is raised. Amazon does not stock the Mac Studio M5 Ultra (256 GB): Apple builds it to order.
On memory, yes (its Mac runtime carries a caveat: Runs on llama.cpp b12406+ (PR #32217) and oMLX 0.8.0 (18 Nov 2026, PR #5229), but no plain-decode Mac run on a released runtime is in the index yet; stock mlx-lm cannot load it (#2061)). Inkling 2 Small needs about 228 GB of unified memory at a short (4K-token) context, so it runs on 4 of the 54 Mac configurations in the LLMCheck index; 2 of them hold it inside macOS’s default GPU memory limit and 2 only after raising that limit. The smallest Mac Apple sells new that runs it is the Mac Studio M5 Ultra (256 GB).
About 228 GB at a 4K context: the weights plus about 2 GB for the runtime. Context adds KV cache: about 229 GB in total at 32K and 231 GB at 64K with the default 16-bit cache (about 230 GB at 64K with a q8 cache). These are estimates from the model’s config.json, not measurements.
On an M5 Ultra, the chip the leaderboard quotes it on, the index figure is ~36 tok/s (estimated) at Q4_K_M. No published or community run is in the index yet; every speed is an estimate from the memory-bandwidth model. Every Mac’s figure is in the table on this page with its provenance: published, community run or estimated.
Among Macs Apple sells new, the Mac Studio M5 Ultra (256 GB), $9,499 new (Apple list price, checked 2026-11-14), is the cheapest that reaches 15 tok/s with Inkling 2 Small, at ~36 tok/s (estimated), after raising the GPU memory limit.
On 2 of the 54 configurations, yes: Mac Studio M5 Ultra 256 GB, Mac Studio M3 Ultra 256 GB (used). macOS lets the GPU use only part of unified memory by default (about 223 GB on the Mac Studio M5 Ultra (256 GB)), and Inkling 2 Small needs about 228 GB. Running sudo sysctl iogpu.wired_limit_mb=245760 in Terminal raises the limit on a 256 GB Mac until the next restart. From 512 GB up, every Mac Apple sells new holds it inside the default limit.
Q4_K_M (about 339 GB of weights) is the common 4-bit GGUF choice. Q8_0 (about 630 GB) is closer to full quality and needs more memory than any Mac has. Q3_K_M and Q2_K shrink it to about 291 and 202 GB at a quality cost. The index’s reference figure (36 tok/s on an M5 Ultra) is for its Q4_K_M build.
Its own window is 1M tokens. At macOS’s default GPU limit, the Mac Studio M5 Ultra (512 GB) holds about 1M (the full window).
LLMCheck. (2026). Can I run Inkling 2 Small on a Mac? llmcheck.net. https://llmcheck.net/can-i-run/inkling-2-small/ (updated ). CC BY 4.0.