Can I run Nemotron 3.5 Super VL 120B-A12B on a Mac?

Yes: Nemotron 3.5 Super VL 120B-A12B runs on 12 of the 54 Macs in the LLMCheck index. It needs about 72 GB at a 4K context, 73 GB at 64K. Smallest current Mac: Mac Studio M5 Ultra 96 GB; cheapest at 15+ tok/s: Mac Studio M5 Max 128 GB, $5,099. Best measured figure: 74.3 tok/s on an M5 Ultra (community).

RAM at 4K
72
GB
RAM at 64K
73
GB, 16-bit KV
Macs that run it
12
of 54 configs
Best measured
community74.3
tok/s · M5 Ultra

Nemotron 3.5 Super VL 120B-A12B on every Mac

One row per Mac configuration, grouped by product line. The build is the one each speed is for; the context column is the longest prompt that fits inside macOS’s default GPU memory limit with a 16-bit KV cache (“raised” where the limit has to be raised first; “full” when the whole window fits). Speeds are decode tok/s from the LLMCheck index, each with its provenance mark. For large mixture-of-experts models (over 40B total), the formula’s typical error is about 34% (the median gap to 70 measured plain-decode runs; it tends to undershoot (median −33%), and an estimate scaled from the model’s own measured run is usually closer; method).

Runs fits macOS’s default GPU limit, 15+ tok/sRuns, slowly fits, under 15 tok/sRaise GPU limit fits once the limit is raised (command below)Doesn't fit needs more memory than the Mac has
MacVerdictBuildSpeedMax contextModel page
MacBook Air
MacBook Air M5 16 GBDoesn't fit————
MacBook Air M5 24 GBDoesn't fit————
MacBook Air M5 32 GBDoesn't fit————
MacBook Air M1 8 GB refurbDoesn't fit————
MacBook Air M4 16 GB usedDoesn't fit————
MacBook Air M2 16 GB refurbDoesn't fit————
MacBook Air M3 16 GB refurbDoesn't fit————
MacBook Air M1 16 GB refurbDoesn't fit————
MacBook Air M4 24 GB usedDoesn't fit————
MacBook Air M2 24 GB refurbDoesn't fit————
MacBook Air M3 24 GB refurbDoesn't fit————
MacBook Pro
MacBook Pro M6 16 GBDoesn't fit————
MacBook Pro M5 Pro 24 GBDoesn't fit————
MacBook Pro M6 24 GBDoesn't fit————
MacBook Pro M6 32 GBDoesn't fit————
MacBook Pro M5 Pro 48 GBDoesn't fit————
MacBook Pro M5 Max 64 GBDoesn't fit————
MacBook Pro M5 Pro 64 GBDoesn't fit————
MacBook Pro M5 Max 128 GBRunsQ4_0community36 tok/s1M (full)M5 Max page
MacBook Pro M3 Max 64 GB refurbDoesn't fit————
MacBook Pro M3 Max 128 GB refurbRunsQ4_K_Mestimated36 tok/s1M (full)—
Mac mini
Mac mini M6 16 GBDoesn't fit————
Mac mini M5 Pro 24 GBDoesn't fit————
Mac mini M6 24 GBDoesn't fit————
Mac mini M6 32 GBDoesn't fit————
Mac mini M5 Pro 48 GBDoesn't fit————
Mac mini M5 Pro 64 GBDoesn't fit————
Mac mini M2 Pro 16 GB refurbDoesn't fit————
Mac mini M4 16 GB usedDoesn't fit————
Mac mini M4 Pro 24 GB usedDoesn't fit————
Mac mini M4 24 GB usedDoesn't fit————
Mac mini M2 Pro 32 GB refurbDoesn't fit————
Mac mini M4 Pro 48 GB usedDoesn't fit————
Mac mini M4 Pro 64 GB usedDoesn't fit————
iMac
iMac M6 16 GBDoesn't fit————
iMac M6 24 GBDoesn't fit————
iMac M6 32 GBDoesn't fit————
Mac Studio
Mac Studio M5 Max 36 GBDoesn't fit————
Mac Studio M5 Max 48 GBDoesn't fit————
Mac Studio M5 Max 64 GBDoesn't fit————
Mac Studio M5 Ultra 96 GBRuns4-bitcommunity74 tok/s690KM5 Ultra page
Mac Studio M5 Max 128 GBRunsQ4_0community36 tok/s1M (full)M5 Max page
Mac Studio M5 Ultra 256 GBRuns4-bitcommunity74 tok/s1M (full)M5 Ultra page
Mac Studio M5 Ultra 512 GBRuns4-bitcommunity74 tok/s1M (full)M5 Ultra page
Mac Studio M2 Max 32 GB refurbDoesn't fit————
Mac Studio M1 Ultra 64 GB refurbDoesn't fit————
Mac Studio M4 Max 64 GB usedDoesn't fit————
Mac Studio M2 Max 64 GB refurbDoesn't fit————
Mac Studio M1 Ultra 128 GB refurbRunsQ4_K_Mestimated58 tok/s1M (full)—
Mac Studio M2 Ultra 128 GB refurbRunsQ4_K_Mestimated58 tok/s1M (full)—
Mac Studio M4 Max 128 GB usedRuns4-bitcommunity51 tok/s1M (full)M4 Max page
Mac Studio M2 Ultra 192 GB refurbRunsQ4_K_Mestimated58 tok/s1M (full)—
Mac Studio M3 Ultra 256 GB usedRunsQ4_K_Mestimated59 tok/s1M (full)—
Mac Studio M3 Ultra 512 GB refurbRunsQ4_K_Mestimated59 tok/s1M (full)—
Provenance key
sourced
Published figure — vendor or press review
estimated
community
Linked individual run — blog, forum or submission

Context memory is computed from its config.json (hybrid Mamba-2: attention on 8 of 88 layers; Mamba layers keep a constant state): about 0.5 GB of 16-bit KV cache at 64K tokens. A q8 cache (llama.cpp -ctk q8_0 -ctv q8_0, Ollama OLLAMA_KV_CACHE_TYPE=q8_0) halves that part. Runtimes also grow a compute buffer with context, so a fit within about 1 GB of the limit is optimistic.

macOS’s GPU memory limit

macOS lets the GPU use only part of unified memory by default. Nemotron 3.5 Super VL 120B-A12B fits inside that default limit on every Mac it fits at all, so no Mac in the table needs it raised at a short context. Long contexts may still need it: the context column already uses each Mac’s default limit.

Nemotron 3.5 Super VL 120B-A12B: memory by quantization

Weights are 120B parameters at each format’s effective size (the index’s GB-per-billion table), plus about 2 GB for the runtime and a short context; longer contexts add the KV cache computed from the model’s config.json at 16 bits. It is a mixture-of-experts model: all 120B parameters sit in memory although only 12B are read per token. The first row is the catalog’s own figure (about 72 GB at a 4K context), the one every verdict on this page uses. “Smallest Mac” is the smallest memory size among the Macs Apple sells new that holds it at a 4K context inside that Mac’s default GPU limit. Estimates, not measurements.

BuildWeightsRAM at 4Kat 32Kat 64KSmallest Mac
As catalogued—72 GB72 GB73 GB96 GB
Q2_K40.8 GB43 GB43 GB43 GB64 GB
Q3_K_M58.8 GB61 GB61 GB61 GB96 GB
Q4_K_M68.4 GB70 GB71 GB71 GB96 GB
Q5_K_M85.2 GB87 GB87 GB88 GB128 GB
Q6_K98.4 GB100 GB101 GB101 GB128 GB
Q8_0127.2 GB129 GB129 GB130 GB256 GB
F16240.0 GB242 GB242 GB243 GB512 GB

Measured runs of Nemotron 3.5 Super VL 120B-A12B

Every published (filled square) and community (hollow circle) run the index holds for Nemotron 3.5 Super VL 120B-A12B: 0 published, 6 community, each linked to its source. LLMCheck runs no tests of its own. One row is one measurement session; on each chip the table above shows the lower median of the eligible runs (plain decode at 5 bits or fewer), and a binned or “not an anchor” run is shown but never used as a reference.

ChipRuntimeQuantDecodeContextDateSource
M5 Ultra 96 GBMLX4-bitcommunity74.3 tok/s1k2026-10-19omlx.ai
M5 Max 128 GBMLX4-bitcommunity51.8 tok/s512-token coding answers, median of 5 at T 0.62026-10-18github.com
M5 Max 128 GBMLX4-bitcommunity45.5 tok/s512-token coding answers, median of 5 at T 0.62026-10-18github.com
M5 Max 128 GBllama.cppQ4_0community35.9 tok/s512-token coding answers, median of 5 at T 0.62026-10-18github.com
M5 Max 128 GBMLXNVFP4community30.6 tok/s160 generated tokens, greedy2026-10-16github.com
M4 Max 128 GBMLX4-bitcommunity50.8 tok/s1k2026-10-18omlx.ai

Recommended setup

The quickest start is Ollama. Pull the model by its tag (checked on ollama.com, 2026-11-14; the file is about 90 GB):

ollama run nemotron-3.5-super:120b

Prefer a window to a terminal? LM Studio downloads the same model with one click. · model card →

On the Mac Studio M5 Ultra (96 GB), the smallest current Mac that runs it inside the default GPU limit, the index figure is 74 tok/s (community run) at 4-bit; keep the context at or under 690K there, or use a q8 KV cache. Note: the nemotron-3.5-super:120b tag is about 90 GB, so it needs a 128 GB Mac; on 96 GB use a ~5-bit build after raising the GPU limit.

Step-by-step: the Ollama install guide.

🛒 Which Mac to get for Nemotron 3.5 Super VL 120B-A12B

Mac Studio M5 Ultra (96 GB) — smallest current Mac that runs it, $5,499 new (Apple list price, checked 2026-11-14), 74 tok/s (community run). For Ollama: the nemotron-3.5-super:120b tag is about 90 GB, so it needs a 128 GB Mac; on 96 GB use a ~5-bit build after raising the GPU limit. Mac Studio M5 Max (128 GB) — cheapest at 15+ tok/s, $5,099 new (Apple list price, checked 2026-11-14), 36 tok/s (community run). Amazon does not stock the Mac Studio M5 Ultra (96 GB): Apple builds it to order. Amazon does not stock the Mac Studio M5 Max (128 GB): Apple builds it to order.

FAQ: Nemotron 3.5 Super VL 120B-A12B on a Mac

Can I run Nemotron 3.5 Super VL 120B-A12B on a Mac?

Yes. Nemotron 3.5 Super VL 120B-A12B needs about 72 GB of unified memory at a short (4K-token) context, so it runs on 12 of the 54 Mac configurations in the LLMCheck index. The smallest Mac Apple sells new that runs it is the Mac Studio M5 Ultra (96 GB).

How much RAM does Nemotron 3.5 Super VL 120B-A12B need?

About 72 GB at a 4K context: the weights plus about 2 GB for the runtime. Context adds KV cache: about 73 GB in total at 32K and 73 GB at 64K with the default 16-bit cache (about 73 GB at 64K with a q8 cache). These are estimates from the model’s config.json, not measurements.

How fast does Nemotron 3.5 Super VL 120B-A12B run on a Mac?

On an M5 Max, the chip the leaderboard quotes it on, the index figure is 36 tok/s (community run) at Q4_0. The best measured figure is 74.3 tok/s on an M5 Ultra 96 GB (community run, 4-bit). Every Mac’s figure is in the table on this page with its provenance: published, community run or estimated.

What is the cheapest Mac that runs Nemotron 3.5 Super VL 120B-A12B well?

Among Macs Apple sells new, the Mac Studio M5 Max (128 GB), $5,099 new (Apple list price, checked 2026-11-14), is the cheapest that reaches 15 tok/s with Nemotron 3.5 Super VL 120B-A12B, at 36 tok/s (community run).

Do I need to raise the GPU memory limit to run Nemotron 3.5 Super VL 120B-A12B?

No. On all 12 Mac configurations where Nemotron 3.5 Super VL 120B-A12B fits, it fits inside that Mac’s default GPU memory limit at a short context; only a long context on the smallest of them can push it over.

Which quantization of Nemotron 3.5 Super VL 120B-A12B should I use?

Q4_K_M (about 68 GB of weights) is the common 4-bit GGUF choice. Q8_0 (about 127 GB) is closer to full quality and needs a 256 GB Mac at the default GPU limit. Q3_K_M and Q2_K shrink it to about 59 and 41 GB at a quality cost. The index’s reference figure (36 tok/s on an M5 Max) is for its Q4_0 build.

How much context can Nemotron 3.5 Super VL 120B-A12B use on a Mac?

Its own window is 1M tokens. At macOS’s default GPU limit, the Mac Studio M5 Ultra (96 GB) holds about 690K. The full window needs about 81 GB, which a 128 GB Mac holds at the default limit. A q8 KV cache roughly doubles these lengths.

Cite this page

LLMCheck. (2026). Can I run Nemotron 3.5 Super VL 120B-A12B on a Mac? llmcheck.net. https://llmcheck.net/can-i-run/nemotron-35-super-vl-120b-a12b/ (updated ). CC BY 4.0.

How to cite LLMCheck →Data: CC BY 4.0Markdown version

Related

Figures from the LLMCheck index, data version 2026-11-18. Verdicts and context limits are estimates from each model’s catalog memory figure and config.json.