MLX LM
The package behind every `mlx_lm.generate` command on this site.
When to use it
Use this as your default: it downloads from Hugging Face, runs text generation, serves an OpenAI-compatible endpoint, and fine-tunes, all from one CLI.
Alternatives in Runtimes
MLX
Apple's own array framework, built so unified memory stops being a compromise.
MLX Swift
MLX's tensor core, ported so Swift apps don't need a Python bridge.
llama.cpp
The C++ runtime that made GGUF and Metal inference normal.
MLC LLM
A compiler-first runtime that targets Metal, CUDA and mobile from one graph.
Candle
Hugging Face's minimalist Rust tensor library, Metal backend included.