Run Nemotron Cascade 2 on M5 Max

Yes — Nemotron Cascade 2 (30B) runs at 35 tok/s on M5 Max with 64 GB RAM using Q4_K_M quantization via Ollama. First token latency is 0.9s. NVIDIA's Nemotron Cascade 2, a hybrid SSM-Transformer 30B model.

Speed
35
tok/s
First Token
0.9
seconds
RAM Needed
64
GB minimum
Engine
Ollama
recommended

Benchmark Details

LLMCheck measured Nemotron Cascade 2 on M5 Max using the standard methodology: Q4_K_M quantization, 256-token input, 512-token output, 3 runs averaged on a freshly-booted system.

MetricValue
Tokens per second35 tok/s
Time to first token0.9s
QuantizationQ4_K_M
Minimum RAM64 GB
Recommended engineOllama
Parameters30B
Benchmark date2026-04

Q4_K_M 30B Ollama M5 Max

Setup Guide: Run Nemotron Cascade 2 on M5 Max

The recommended engine for Nemotron Cascade 2 on M5 Max is Ollama. Install Ollama, then pull the model:

ollama run nemotron-cascade:2

Ollama handles quantization automatically — it will download the Q4_K_M variant (~64 GB) and start an interactive chat session.

Performance on Other Apple Silicon Chips

ChipSpeedFirst TokenMin RAMEngine
M4 Max 28 tok/s 1.2s 48 GB MLX
M4 Pro 22 tok/s 1.5s 24 GB Ollama

System Requirements

To run Nemotron Cascade 2 on M5 Max you need:

Compare More Models

See how Nemotron Cascade 2 stacks up against other models on your specific Mac hardware.

Open Compare Tool Full Leaderboard