Run Mistral Medium 4 on M3 Max

Yes — Mistral Medium 4 (41B) runs at 30 tok/s on M3 Max with 64 GB RAM using Q4_K_M quantization via Ollama. First token latency is 1.0s. A capable open-source LLM with 41B parameters.

Speed
30
tok/s
First Token
1.0
seconds
RAM Needed
64
GB minimum
Engine
Ollama
recommended

Benchmark Details

LLMCheck measured Mistral Medium 4 on M3 Max using the standard methodology: Q4_K_M quantization, 256-token input, 512-token output, 3 runs averaged on a freshly-booted system.

MetricValue
Tokens per second30 tok/s
Time to first token1.0s
QuantizationQ4_K_M
Minimum RAM64 GB
Recommended engineOllama
Parameters41B
Benchmark date2026-07

Q4_K_M 41B Ollama M3 Max

Setup Guide: Run Mistral Medium 4 on M3 Max

The recommended engine for Mistral Medium 4 on M3 Max is Ollama. Install Ollama, then pull the model:

ollama run mistral-medium-4

Ollama handles quantization automatically — it will download the Q4_K_M variant (~64 GB) and start an interactive chat session.

Performance on Other Apple Silicon Chips

ChipSpeedFirst TokenMin RAMEngine
M5 Max 48 tok/s 0.6s 128 GB MLX
M5 Max 42 tok/s 0.7s 64 GB Ollama
M4 Max 38 tok/s 0.8s 48 GB MLX

System Requirements

To run Mistral Medium 4 on M3 Max you need:

🛒 Get a Mac that runs Mistral Medium 4

Mistral Medium 4 needs about 64 GB of unified memory. These current Apple Silicon Macs have the headroom to run it comfortably:

Not sure which Mac fits your budget? See the best Mac for running this →

As an Amazon Associate, LLMCheck earns from qualifying purchases. These affiliate links cost you nothing extra and help keep our benchmarks free.

Compare More Models

See how Mistral Medium 4 stacks up against other models on your specific Mac hardware.

Open Compare Tool Full Leaderboard