product
Data quality: Editorially ReviewedLanguage (LLM / NLP)
Free
MLOps & Infrastructure
Software & technology
Self-hosted / on-premises
Desktop application
Developer tool
Code generation & assistance
LLaMA.cpp
MLOps & Infrastructure
Overview
llama.cpp is an open-source C/C++ implementation of the LLaMA model that enables efficient LLM inference on CPUs and GPUs. It provides GGUF model format support, quantization for reduced memory usage, and bindings for Python, Node.js, and other languages. llama.cpp is the underlying engine for many local LLM tools including Ollama and LM Studio.
- Pricing model
- Free
- Deployment
- Self-hosted / on-premises, Desktop application
- Regions served
- Global
- Categories
- Language (LLM / NLP), Free, MLOps & Infrastructure, Software & technology, Self-hosted / on-premises, Desktop application, Developer tool, Code generation & assistance
- Last updated
- 2 October 2026
- Published
- 2 October 2026
Use cases
Code generation & assistance
Deployment options
Self-hosted / on-premises
Desktop application
Data sources & provenance
Where this information came from, how it was checked and when it was last looked at. “Last updated” records a change to the record — it does not mean the record was verified.
- Data quality
- Data quality: Editorially Reviewed
- Primary source
- github.com
- Sources cited
- 2
- Last reviewed
- 28 September 2026
- Last updated
- 2 October 2026
Spotted something out of date?
Anyone can suggest a correction — you don't need an account. An editor checks every suggestion against the sources before the record changes.