runner
Open source
free
4.5/5
MLX-LM
Apple's Metal-native ML framework's LLM runner. Now competitive with llama.cpp Metal on M-series silicon, with better long-context performance.
Overview
Apple's Metal-native ML framework's LLM runner. Now competitive with llama.cpp Metal on M-series silicon, with better long-context performance.
Pros
- Native Apple Silicon
- Active Apple development
- Strong long-context
Cons
- Apple-only
- MLX quant format separate from GGUF
Compatibility
| Operating systems | macOS |
| GPU backends | Apple Metal |
| License | Open source · free |
Get MLX-LM
Frequently asked
Is MLX-LM free?
Yes — MLX-LM is free to download and use and open-source under a permissive license.
What operating systems does MLX-LM support?
MLX-LM supports macOS.
Which GPUs work with MLX-LM?
MLX-LM supports Apple Metal. CPU-only inference is also possible but slow.
Reviewed by RunLocalAI Editorial. See our editorial policy for how we evaluate tools.