Local LLM Runtimes in AI & Machine Learning

Ollama

ollama/ollama

Popular

Easiest way to pull and run open models locally behind an OpenAI-compatible API; the default local runtime.

186k5d ago

llama.cpp

ggml-org/llama.cpp

Popular

C/C++ LLM inference engine behind GGUF and most local tools; runs on CPUs, Apple Silicon and GPUs.

134ktoday

LM Studio

lmstudio.ai

Popular

Desktop app for discovering, downloading and running local models with a chat UI and local API server.

app

MLX

ml-explore/mlx

Rising

Apple's array framework for machine learning on Apple Silicon, with mlx-lm for fast local LLMs.

29.1k338k/wk5d ago+42%

Jan

janhq/jan

Open-source, offline-first ChatGPT alternative desktop app running local models via llama.cpp.

45.7ktoday

LocalAI

mudler/LocalAI

Self-hosted, OpenAI-compatible API for running LLMs, image and audio models on consumer hardware.

50.2k4d ago

llamafile

mozilla-ai/llamafile

Mozilla project that packages a model and llama.cpp into a single cross-platform executable.

26.6k6d ago

KoboldCpp

LostRuins/koboldcpp

Single-file llama.cpp-based runner with a web UI, popular for local storytelling and roleplay.

12.2k2d ago


1	OllamaPopular Easiest way to pull and run open models locally behind an OpenAI-compatible API; the default local runtime.	186k	n/a	n/a	5d ago	96
2	llama.cppPopular C/C++ LLM inference engine behind GGUF and most local tools; runs on CPUs, Apple Silicon and GPUs.	134k	n/a	n/a	today	94
3	LM StudioPopular Desktop app for discovering, downloading and running local models with a chat UI and local API server.	No public repository or package of its own to measure
4	MLXRising Apple's array framework for machine learning on Apple Silicon, with mlx-lm for fast local LLMs.	29.1k	338k	+42%	5d ago	74
5	Jan Open-source, offline-first ChatGPT alternative desktop app running local models via llama.cpp.	45.7k	n/a	n/a	today	85
6	LocalAI Self-hosted, OpenAI-compatible API for running LLMs, image and audio models on consumer hardware.	50.2k	n/a	n/a	4d ago	86
7	llamafile Mozilla project that packages a model and llama.cpp into a single cross-platform executable.	26.6k	n/a	n/a	6d ago	81
8	KoboldCpp Single-file llama.cpp-based runner with a web UI, popular for local storytelling and roleplay.	12.2k	n/a	n/a	2d ago	75


1	OllamaPopular Easiest way to pull and run open models locally behind an OpenAI-compatible API; the default local runtime.	186k	n/a	n/a	5d ago	96
2	llama.cppPopular C/C++ LLM inference engine behind GGUF and most local tools; runs on CPUs, Apple Silicon and GPUs.	134k	n/a	n/a	today	94
3	LM StudioPopular Desktop app for discovering, downloading and running local models with a chat UI and local API server.	No public repository or package of its own to measure
4	MLXRising Apple's array framework for machine learning on Apple Silicon, with mlx-lm for fast local LLMs.	29.1k	338k	+42%	5d ago	74
5	Jan Open-source, offline-first ChatGPT alternative desktop app running local models via llama.cpp.	45.7k	n/a	n/a	today	85
6	LocalAI Self-hosted, OpenAI-compatible API for running LLMs, image and audio models on consumer hardware.	50.2k	n/a	n/a	4d ago	86
7	llamafile Mozilla project that packages a model and llama.cpp into a single cross-platform executable.	26.6k	n/a	n/a	6d ago	81
8	KoboldCpp Single-file llama.cpp-based runner with a web UI, popular for local storytelling and roleplay.	12.2k	n/a	n/a	2d ago	75

Local LLM Runtimes

Ollama

llama.cpp

LM Studio

MLX

Jan

LocalAI

llamafile

KoboldCpp

Comparison

Local LLM Runtimes

Ollama

llama.cpp

LM Studio

MLX

Jan

LocalAI

llamafile

KoboldCpp

Comparison

Search TechInTrends

Local LLM Runtimes

Ollama

llama.cpp

LM Studio

MLX

Jan

LocalAI

llamafile

KoboldCpp

Comparison

Local LLM Runtimes

Ollama

llama.cpp

LM Studio

MLX

Jan

LocalAI

llamafile

KoboldCpp

Comparison