Software to Run
Local AI on Your Mac

Beautiful desktop app with a built-in model browser. Browse hundreds of models, download with one click, and start chatting instantly. Feels like using ChatGPT — but everything runs on your Mac. The 0.4.x releases added Bionic, a companion app that turns any local model into a file-editing, script-running agent.

Open-source desktop app designed to feel like ChatGPT. Clean conversation threads, model management, and full offline capability. Great if you want a familiar chat experience without cloud dependency.

Nomic's free desktop chatbot focused on simplicity. Standout feature: point it at a folder of PDFs or notes and ask questions about your own documents — all processed locally.

Modern desktop app that connects to both local models and cloud APIs. Supports Ollama models, online providers, and lets you compare outputs side-by-side. Beautiful Mac-native design.

Open-source web app you run locally that connects to Ollama, OpenAI, or any API. Beautiful ChatGPT-like interface with conversation history, prompt templates, and markdown rendering. Easy one-click deploy.

Lightweight tool that downloads and runs models with a single command — and since v0.32, typing ollama opens an interactive local coding agent. Its native MLX engine delivers 2x faster token generation than the old backend, uses the M5 Neural Accelerators (time-to-first-token up to 4x faster vs M4), accepts image input, and supports DFlash speculative decoding. Runs as a background service — many GUI apps connect to it.

Beautiful SwiftUI app built specifically for Mac and iPhone. Connects to Ollama running on your Mac and gives you a polished, Apple-native chat experience. Also works on iPad and iPhone.

Comprehensive platform combining local AI chat with document management, workspaces, and agents. Upload PDFs and web pages, then chat with them using your local models.

Optimized inference toolkit for deploying LLMs locally with quantization support. Achieves up to 1.8x faster inference than standard Ollama through efficient memory management and batched processing. Great for running multiple concurrent requests.

Apple's machine learning framework designed from the ground up for Apple Silicon. According to the LLMCheck index, MLX achieves the highest possible performance by fully leveraging unified memory, Metal GPU, and the Neural Engine.

The C/C++ inference engine powering most local AI tools under the hood. Gives you full control over quantization, context lengths, batch sizes, and Metal GPU offloading.

Feature-rich web UI that connects to Ollama or any OpenAI-compatible API. Supports multiple users, RAG document chat, web browsing, image generation, and plugin extensions.

Revolutionary tool that lets you pool multiple Apple Silicon Macs together over your local network to run larger models. Two M4 Max 64GB Macs become a single 128GB inference cluster. Perfect for running 70B+ models without a single high-RAM machine.