Run Nemotron 3.5 Lightning on M6

Yes — Nemotron 3.5 Lightning (30B-A3B) runs at 45 tok/s on M6 with 32 GB RAM using Q4_K_M quantization via llama.cpp. A capable open-source LLM with 30B-A3B parameters.

Speed
community45
tok/s
First Token
—
seconds
RAM Needed
32
GB minimum
Engine
llama.cpp
recommended
Want to run Nemotron 3.5 Lightning faster — or step up to bigger models? Find your Mac →

Benchmark Details

The LLMCheck index estimates Nemotron 3.5 Lightning on M6 using our published methodology: Q4_K_M quantization, memory-bandwidth scaling, and cross-referenced third-party benchmarks where available. Figures are transparent estimates — own this config? Submit a real benchmark →

MetricValue
Tokens per second45 tok/s
Time to first token—
QuantizationQ4_K_M
Minimum RAM32 GB
Recommended enginellama.cpp
Parameters30B-A3B
Benchmark date2026-10

Q4_K_M 30B-A3B llama.cpp M6

Setup Guide: Run Nemotron 3.5 Lightning on M6

The recommended engine for Nemotron 3.5 Lightning on M6 is llama.cpp. Install Ollama, then pull the model:

ollama run nemotron-35-lightning

Ollama handles quantization automatically — it will download the Q4_K_M variant (~32 GB) and start an interactive chat session.

Performance on Other Apple Silicon Chips

ChipSpeedFirst TokenMin RAMEngine

System Requirements

To run Nemotron 3.5 Lightning on M6 you need:

🛒 Get a Mac that runs Nemotron 3.5 Lightning

Nemotron 3.5 Lightning needs about 32 GB of unified memory. These current Apple Silicon Macs have the headroom to run it comfortably:

As an Amazon Associate, LLMCheck earns from qualifying purchases. These affiliate links cost you nothing extra and help keep the LLMCheck index free.

Compare More Models

See how Nemotron 3.5 Lightning stacks up against other models on your specific Mac hardware.

Open Compare Tool Full Leaderboard