Side-by-side comparison

Apple's array framework for machine learning on Apple Silicon, with mlx-lm for fast local LLMs.

Easiest way to pull and run open models locally behind an OpenAI-compatible API; the default local runtime.

C/C++ LLM inference engine behind GGUF and most local tools; runs on CPUs, Apple Silicon and GPUs.

Open-source, offline-first ChatGPT alternative desktop app running local models via llama.cpp.