Skip to content
mlx.app

AI on Apple silicon

Your Mac can run more than you think. Here is exactly what.

Pick your machine. We do the arithmetic on unified memory, the KV cache and memory bandwidth, and give you the model, the verdict and the command.

48 GB installed · about 38.4 GB usable after macOS
Best model for this Mac

Qwen3 30B-A3B Instruct 2507

30.5B · 3.3B active · q6 · 8K context

FITS · 12.8 GB FREE
macOS9.6 GBweights24.8 GBKV cache0.8 GBheadroom12.8 GB
Weights
24.8 GB
KV cache
0.8 GB
Generation
79.4 tok/sest.
Headroom
12.8 GB
Run it
mlx_lm.chat --model mlx-community/Qwen3-30B-A3B-Instruct-2507-6bit
Full model page 33 of 39 models fit this Mac at 8K context.
8K tokens
2K8K32K128K
KV cache

What else fits

Ranked by how comfortably each one sits in your memory, then by speed.

All models

Qwen3 Coder 30B-A3B Instruct

Alibaba · 30.5B (3.3B active) · q6

FITS · 12.8 GB FREE

This is the current go-to local coding model for a 32GB Mac, trading some raw code-quality against Qwen2.5-Coder-32B for much faster generation. Its 262K context window means it can hold a real codebase's worth of files in one session, which the dense coder can't do as cheaply.

~79.4 tok/s est.8K ctxcommercial ok

Qwen2.5-VL 32B Instruct

Alibaba · 33B · q4

FITS · 17.7 GB FREE

The 32GB-Mac step up from the 7B vision model, with meaningfully better reasoning about multi-image and multi-step visual tasks. It's slower per image than the 7B, so batch document processing is where the extra memory cost pays off most.

~11.5 tok/s est.8K ctxcommercial ok

DeepSeek R1 Distill Qwen 32B

DeepSeek · 32.5B · q4

FITS · 18.0 GB FREE

Distilled from DeepSeek R1's reasoning traces onto a Qwen2.5 32B base, so on a 32GB Mac you get long chain-of-thought behavior without the 671B parent's memory bill. Expect verbose answers full of visible reasoning steps, which is either useful or annoying depending on the task.

~11.6 tok/s est.8K ctxcommercial ok

Mixtral 8x7B Instruct v0.1

Mistral AI · 46.7B (12.9B active) · q4

FITS · 11.1 GB FREE

One of the earliest MoE models to run well on Apple Silicon, needing a 32GB Mac for 4-bit despite having only 12.9B active parameters per token. It still runs faster than a dense 46B model would, but newer MoE designs like Qwen3-30B-A3B have mostly superseded it on quality.

~29.3 tok/s est.8K ctxcommercial ok

Qwen3 32B

Alibaba · 32.8B · q6

FITS · 9.6 GB FREE

Currently the strongest dense text model that a 32GB Mac can run at a usable quant, and its thinking mode holds up on genuinely hard reasoning benchmarks. If you have the memory budget, this outperforms Qwen3-30B-A3B on quality per token even though it's slower.

~8.0 tok/s est.8K ctxcommercial ok

GPT-OSS 20B

OpenAI · 21B (3.6B active) · q8

FITS · 15.7 GB FREE

OpenAI's first open-weight release since GPT-2, shipped natively in 4-bit MXFP4 so it already fits a 16GB Mac without further quantization. It uses OpenAI's harmony chat format and a configurable reasoning effort setting rather than a simple thinking toggle.

~55.7 tok/s est.8K ctxcommercial ok

Start somewhere

Three ways in, depending on what you're deciding.

The handbook

Thirteen articles on how this actually works, written to be read once and remembered.

Read the handbook

The ecosystem

42 tools, each with an honest note on when it's the right choice.

Tools directory

Every memory and speed figure on this site is computed from published specifications and model configs, and marked est. Measured numbers come from community submissions and say so.