Your Mac can run more than you think. Here is exactly what.
Pick your machine. We do the arithmetic on unified memory, the KV cache and memory bandwidth, and give you the model, the verdict and the command.
Qwen3 30B-A3B Instruct 2507
30.5B · 3.3B active · q6 · 8K context
- Weights
- 24.8 GB
- KV cache
- 0.8 GB
- Generation
- 79.4 tok/sest.
- Headroom
- 12.8 GB
mlx_lm.chat --model mlx-community/Qwen3-30B-A3B-Instruct-2507-6bitWhat else fits
Ranked by how comfortably each one sits in your memory, then by speed.
Qwen3 Coder 30B-A3B Instruct
Alibaba · 30.5B (3.3B active) · q6
This is the current go-to local coding model for a 32GB Mac, trading some raw code-quality against Qwen2.5-Coder-32B for much faster generation. Its 262K context window means it can hold a real codebase's worth of files in one session, which the dense coder can't do as cheaply.
Qwen2.5-VL 32B Instruct
Alibaba · 33B · q4
The 32GB-Mac step up from the 7B vision model, with meaningfully better reasoning about multi-image and multi-step visual tasks. It's slower per image than the 7B, so batch document processing is where the extra memory cost pays off most.
DeepSeek R1 Distill Qwen 32B
DeepSeek · 32.5B · q4
Distilled from DeepSeek R1's reasoning traces onto a Qwen2.5 32B base, so on a 32GB Mac you get long chain-of-thought behavior without the 671B parent's memory bill. Expect verbose answers full of visible reasoning steps, which is either useful or annoying depending on the task.
Mixtral 8x7B Instruct v0.1
Mistral AI · 46.7B (12.9B active) · q4
One of the earliest MoE models to run well on Apple Silicon, needing a 32GB Mac for 4-bit despite having only 12.9B active parameters per token. It still runs faster than a dense 46B model would, but newer MoE designs like Qwen3-30B-A3B have mostly superseded it on quality.
Qwen3 32B
Alibaba · 32.8B · q6
Currently the strongest dense text model that a 32GB Mac can run at a usable quant, and its thinking mode holds up on genuinely hard reasoning benchmarks. If you have the memory budget, this outperforms Qwen3-30B-A3B on quality per token even though it's slower.
GPT-OSS 20B
OpenAI · 21B (3.6B active) · q8
OpenAI's first open-weight release since GPT-2, shipped natively in 4-bit MXFP4 so it already fits a 16GB Mac without further quantization. It uses OpenAI's harmony chat format and a configurable reasoning effort setting rather than a simple thinking toggle.
Start somewhere
Three ways in, depending on what you're deciding.
I'm buying a Mac
Enter the models you want to run and see the cheapest configuration that runs them well.
I've never run one
Install, download and generate your first tokens in about five minutes. No account, no key.
I want real numbers
Measured throughput submitted by people with the same chip, next to our estimates.
The handbook
Thirteen articles on how this actually works, written to be read once and remembered.
Unified memory, explained properly
Why a Mac with 48 GB behaves unlike a PC with a 24 GB graphics card, and where the limit actually sits.
Quantization without the hand-waving
What 4-bit actually means, why the file is bigger than the arithmetic suggests, and when the quality loss starts to matter.
The KV cache is the thing that surprises people
Your model fit at 4K context and died at 128K. This is why, and how to calculate it in advance.
Why tokens per second is a bandwidth problem
Decode speed is almost entirely predictable from memory bandwidth and model size. Here is the arithmetic.
Mixture-of-experts: big model, small bill at inference
Why a 30B MoE can feel like a 3B model, and what it costs you in memory to get that.
Context windows: advertised, usable, and affordable
A model that claims 128K rarely gives you 128K useful tokens, and you probably cannot afford them anyway.
The ecosystem
42 tools, each with an honest note on when it's the right choice.
Every memory and speed figure on this site is computed from published specifications and model configs, and marked est. Measured numbers come from community submissions and say so.