1
→About ggml-org/llama.cpp
ggml-org/llama.cpp is an open-source project on GitHub, mainly written in C++. LLM inference in C/C++ It currently holds 128,922 stars and 23,481 forks with 2,523 open issues, and was last pushed on 2026-09-20 (repository created 2023-03-10).
Project Overview
Git Homed tracks it on the Today's Trending board.
GitHub Repository Details
README
llama.cpp
LLM inference in C/C++
ggml / ops / maintainer PRs%20sort%3Aupdated-desc) / dev stats / lib llama API / llama-server REST API
Quick start
A few options to get llama.cpp installed on your machine:
# curl
curl -LsSf https://llama.app/install.sh | sh
powershell
irm https://llama.app/install.ps1 | iex
- Visit https://llama.app and follow the instructions
- Run with Docker - see our Docker documentation
- Download pre-built binaries from the releases page
- Build from source by cloning this repository - check out our build guide
# Download and run a model directly from Hugging Face
llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF
Launch OpenAI-compatible API server
llama serve -hf ggml-org/Qwen3.5-0.8B-GGUF
VLM session with llama cli
|
Built-in web UI against llama serve
|
