exo
Turns a pile of Macs (and phones) into one inference cluster.
When to use it
Use this when a model doesn't fit on one Mac and you'd rather split it across several devices on your network than buy more RAM.
Alternatives in Servers
Ollama
The `ollama run` command that made local models a one-liner.
MLX Omni Server
An OpenAI-compatible server that's actually running MLX underneath.
LM Studio MLX Engine
LM Studio's own MLX backend, open-sourced separately from the app.
Open WebUI
A ChatGPT-shaped front end you point at any local backend.