llama.cpp ☆
« Back to VersTracker
Description:
LLM inference in C/C++
Type: Formula  |  Latest Version: 7540@0  |  Tracked Since: Dec 17, 2025
Links: Homepage  |  GitHub  |  formulae.brew.sh
Stars: 92,086  |  Forks: 14,261  |  Language: C++  |  Category: Ai ml
Tags: llm inference c++ machine-learning quantization local-ai
Install: brew install llama.cpp
About:
llama.cpp is a high-performance inference engine for Large Language Models (LLMs) written in pure C/C++. It enables efficient CPU-based inference with minimal dependencies, making it ideal for deployment on various hardware without requiring powerful GPUs. The project focuses on optimization for Apple Silicon, x86 architectures, and WebAssembly.
Key Features:
  • Pure C/C++ implementation with no external dependencies
  • Optimized for CPU inference (AVX, AVX2, AVX-512, ARM NEON)
  • Support for various LLM architectures (LLaMA, Falcon, GPT-2, etc.)
  • Quantization support for reduced memory usage
  • Cross-platform compatibility (Linux, macOS, Windows, WASM)
Use Cases:
  • Running LLMs locally on consumer hardware without GPUs
  • Embedding LLM capabilities in C/C++ applications
  • Research and experimentation with quantized model inference
Alternatives:
  • transformers – Python library with GPU acceleration, more models but heavier dependencies
  • mlc-llm – TVM-based compiler stack for LLMs across diverse hardware
  • ctransformers – Python bindings for GGML models with similar C++ backend
Version History
Detected Version Rev Change Commit
Dec 27, 2025 11:11am 7540 0 VERSION_BUMP 3e84f33f
Dec 25, 2025 8:08pm 7530 0 VERSION_BUMP 25b51dd8
Dec 24, 2025 2:08pm 7520 0 VERSION_BUMP e1d85360
Dec 22, 2025 11:13pm 7490 0 VERSION_BUMP b0ce7874
Dec 20, 2025 11:02pm 7480 0 VERSION_BUMP 67cb07c4
Dec 19, 2025 2:20pm 7470 0 VERSION_BUMP f230c19c
Dec 18, 2025 5:29pm 7440 0 VERSION_BUMP 4b17c271
Dec 17, 2025 5:17am 0 VERSION_BUMP bdc8459b
Dec 15, 2025 8:07pm 0 VERSION_BUMP 4b1c4eca
Dec 10, 2025 3:34am 0 VERSION_BUMP 57d04e86
Dec 9, 2025 11:08am 0 VERSION_BUMP bcffd955
Dec 6, 2025 11:05pm 0 VERSION_BUMP 8576ba09
Dec 6, 2025 2:07pm 0 VERSION_BUMP 43344f6e
Dec 3, 2025 2:49am 0 VERSION_BUMP 88a9f1a4
Dec 2, 2025 6:43pm 0 VERSION_BUMP 701bab39
Dec 2, 2025 5:22pm 0 VERSION_BUMP ce38ca98
Dec 1, 2025 11:14pm 0 VERSION_BUMP f0b4bca2
Nov 26, 2025 2:17pm 0 VERSION_BUMP 1de2b2b8
Nov 24, 2025 11:46pm 0 VERSION_BUMP 03d1630f
Nov 24, 2025 8:04am 0 VERSION_BUMP 08beafa3
Nov 18, 2025 5:05am 0 VERSION_BUMP 017d6597
Nov 15, 2025 5:06pm 0 VERSION_BUMP f0fe4a1d
Nov 14, 2025 7:52am 0 VERSION_BUMP 7cb51f2d
Nov 11, 2025 2:10pm 0 VERSION_BUMP fbeeb33b
Nov 8, 2025 11:10pm 0 VERSION_BUMP af4f04b9
Nov 3, 2025 11:10pm 0 VERSION_BUMP e3bf98de
Oct 31, 2025 2:06pm 0 VERSION_BUMP f41a732b
Oct 29, 2025 11:42pm 0 VERSION_BUMP 1adf0c16
Oct 27, 2025 2:40am 0 VERSION_BUMP 64e0b32b
Oct 26, 2025 5:41am 0 VERSION_BUMP 562c12ae
Oct 24, 2025 5:38am 0 VERSION_BUMP c3fbb065
Oct 19, 2025 11:12pm 0 VERSION_BUMP 7116a61d
Oct 17, 2025 5:19pm 0 VERSION_BUMP fb330307
Oct 14, 2025 2:17pm 0 VERSION_BUMP 6df35f94
Oct 13, 2025 11:15am 0 VERSION_BUMP 381cb306
Oct 4, 2025 11:03pm 0 VERSION_BUMP 9004ac30
Oct 3, 2025 11:11am 0 VERSION_BUMP c6880ecd
Oct 1, 2025 9:25pm 0 VERSION_BUMP 4d31b319
Sep 30, 2025 11:40pm 0 VERSION_BUMP 95daa716
Sep 30, 2025 11:11pm 0 VERSION_BUMP 1dd38f83
Sep 29, 2025 5:14am 0 VERSION_BUMP 16dcb0ec
Sep 25, 2025 2:20pm 0 VERSION_BUMP 0008fce5
Sep 22, 2025 8:49pm 0 VERSION_BUMP 81c6ed32
Sep 22, 2025 8:12pm 0 VERSION_BUMP 02157694
Sep 16, 2025 12:55am 0 VERSION_BUMP 8abe18c8
Sep 14, 2025 6:08pm 0 VERSION_BUMP 21048e9b
Sep 14, 2025 5:16pm 0 VERSION_BUMP ab21c79d
Sep 11, 2025 7:05am 0 VERSION_BUMP 471b3011
Aug 26, 2025 8:16am 0 VERSION_BUMP 86118897
Jan 16, 2025 11:01pm 0 VERSION_BUMP 687d9117
Jan 16, 2025 5:02pm 0 VERSION_BUMP 107ba083
Jan 16, 2025 11:31am 0 VERSION_BUMP a781f007
Jan 16, 2025 11:10am 0 VERSION_BUMP 786c8da3
Jan 14, 2025 2:02pm 0 VERSION_BUMP cac86310
Jan 13, 2025 8:07pm 0 VERSION_BUMP cd1d83f3
Jan 13, 2025 2:07pm 0 VERSION_BUMP 90429081
Jan 12, 2025 8:02pm 0 VERSION_BUMP 60aac657
Jan 12, 2025 2:24pm 0 VERSION_BUMP a5611aa0
Jan 12, 2025 2:06pm 0 VERSION_BUMP fe2f9e10
Jan 12, 2025 11:24am 0 VERSION_BUMP caa33486
Jan 12, 2025 11:01am 0 VERSION_BUMP 1a4ac5ba
Jan 10, 2025 8:50am 0 VERSION_BUMP a952f530
Jan 10, 2025 8:07am 0 VERSION_BUMP 3dc9c0a4
Jan 10, 2025 5:30am 0 VERSION_BUMP e3f5eedc
Jan 10, 2025 2:32am 0 VERSION_BUMP 008853e8
Jan 9, 2025 11:02am 0 VERSION_BUMP 6137b4d4
Jan 8, 2025 11:03pm 0 VERSION_BUMP efced902
Jan 8, 2025 5:10pm 0 VERSION_BUMP d69cc996
Jan 8, 2025 2:07pm 0 VERSION_BUMP afb7b7e8
Jan 8, 2025 11:02am 0 VERSION_BUMP c265edc6
Jan 7, 2025 5:08pm 0 VERSION_BUMP 9ac161e0
Jan 6, 2025 2:02pm 0 VERSION_BUMP eb6a4b6e
Jan 6, 2025 2:46am 0 VERSION_BUMP 646d9de0
Jan 6, 2025 2:28am 0 VERSION_BUMP c1388061
Jan 3, 2025 11:06am 0 VERSION_BUMP 53ac1397
Jan 2, 2025 5:07pm 0 VERSION_BUMP e5f73ea1
Dec 31, 2024 2:05pm 0 VERSION_BUMP 3ab63111
Dec 31, 2024 2:23am 0 VERSION_BUMP 30ff02b3
Dec 30, 2024 8:40pm 0 VERSION_BUMP fb2e0ba6
Dec 30, 2024 8:06pm 0 VERSION_BUMP f67f6402
Dec 30, 2024 2:03pm 0 VERSION_BUMP 6e496a5b
Dec 29, 2024 11:06am 0 VERSION_BUMP 9e5d3fc9
Dec 28, 2024 5:02pm 0 VERSION_BUMP f3e16365
Dec 26, 2024 5:40pm 0 VERSION_BUMP 4b90fdce
Dec 26, 2024 5:07pm 0 VERSION_BUMP 652ee772
Dec 23, 2024 11:02am 0 VERSION_BUMP 6c73147b
Dec 23, 2024 2:24am 0 VERSION_BUMP dc2d0b22
Dec 22, 2024 11:01am 0 VERSION_BUMP 3645e3bd
Dec 21, 2024 2:24am 0 VERSION_BUMP 0b6f1fba
Dec 19, 2024 2:01pm 0 VERSION_BUMP 78a953d5
Dec 19, 2024 11:19am 0 VERSION_BUMP 8640390d
Dec 19, 2024 11:01am 0 VERSION_BUMP 4568189b
Dec 19, 2024 5:39am 0 VERSION_BUMP ed1b1b41
Dec 19, 2024 5:05am 0 VERSION_BUMP e5e82648
Dec 18, 2024 11:14pm 0 VERSION_BUMP 4ac57baf
Dec 18, 2024 2:45pm 0 VERSION_BUMP 9f384e35
Dec 18, 2024 2:39am 0 VERSION_BUMP ba6ecae3
Dec 17, 2024 11:07pm 0 VERSION_BUMP a4b15a49
Dec 17, 2024 5:11pm 0 VERSION_BUMP efd0bdfd
Dec 17, 2024 8:24am 0 VERSION_BUMP dd37b7dc
Dec 16, 2024 11:03pm 0 VERSION_BUMP 0a112bba
Dec 15, 2024 8:05pm 0 VERSION_BUMP b7ce962d
Dec 15, 2024 2:14pm 0 VERSION_BUMP 0a443c61
Dec 15, 2024 2:01pm 0 VERSION_BUMP 8c0b31e0
Dec 15, 2024 2:36am 0 VERSION_BUMP 23876a3d
Dec 14, 2024 1:59pm 0 VERSION_BUMP b78af108
Dec 14, 2024 2:33am 0 VERSION_BUMP 1232d0aa
Dec 13, 2024 11:26pm 0 VERSION_BUMP 60715550
Dec 12, 2024 8:08pm 0 VERSION_BUMP a82318ae
Dec 12, 2024 5:08pm 0 VERSION_BUMP 29e75652
Dec 11, 2024 5:15pm 0 VERSION_BUMP 90bdc03c
Dec 11, 2024 2:51am 0 VERSION_BUMP 83a7929e
Dec 11, 2024 2:29am 0 VERSION_BUMP 6e8991e4
Dec 5, 2024 4:04am 0 VERSION_BUMP 0796e998
Dec 4, 2024 11:03pm 0 VERSION_BUMP 97fb1eac
Dec 4, 2024 5:14pm 0 VERSION_BUMP fc6d2556
Dec 4, 2024 8:49am 0 VERSION_BUMP 190789f0
Dec 4, 2024 8:05am 0 VERSION_BUMP da2213b6
Dec 4, 2024 3:18am 0 VERSION_BUMP fc1a196f
Dec 4, 2024 2:34am 0 VERSION_BUMP ded0a305
Dec 3, 2024 9:22pm 0 VERSION_BUMP 54e77632
Dec 3, 2024 8:08pm 0 VERSION_BUMP 783f94b5
Nov 27, 2024 11:07am 0 VERSION_BUMP dca50d06
Nov 27, 2024 2:02am 0 VERSION_BUMP a0507eae
Nov 26, 2024 8:30pm 0 VERSION_BUMP 7f8448e8
Nov 26, 2024 5:12pm 0 VERSION_BUMP 8e39c1d7
Nov 26, 2024 3:02pm 0 VERSION_BUMP 6f6e453d
Nov 26, 2024 9:51am 0 VERSION_BUMP cea02d03
Nov 25, 2024 2:39pm 0 VERSION_BUMP 8c61d8dc
Nov 25, 2024 11:11am 0 VERSION_BUMP 01a358e6
Nov 24, 2024 10:15am 0 VERSION_BUMP e6da3225
Nov 20, 2024 4:50pm 0 VERSION_BUMP 965f1003
Nov 20, 2024 9:48am 0 VERSION_BUMP fc4e0fa8
Nov 20, 2024 1:38am 0 VERSION_BUMP 25c7aee3
Nov 20, 2024 12:56am 0 VERSION_BUMP 78583f13
Nov 19, 2024 9:50pm 0 VERSION_BUMP 7d2374ff
Nov 19, 2024 3:53pm 0 VERSION_BUMP d037286b
Nov 19, 2024 1:26pm 0 VERSION_BUMP f86e6e36
Nov 19, 2024 12:55pm 0 VERSION_BUMP 262ffbd7
Nov 19, 2024 10:12am 0 VERSION_BUMP b31f066c
Nov 19, 2024 3:47am 0 VERSION_BUMP 15d5678d
Nov 18, 2024 8:03pm 0 VERSION_BUMP ffadf7e5
Nov 18, 2024 12:47pm 0 VERSION_BUMP 7e1998e7
Nov 18, 2024 2:20am 0 VERSION_BUMP 8d08e75e
Nov 18, 2024 12:55am 0 VERSION_BUMP d90b522d
Nov 16, 2024 3:45pm 0 VERSION_BUMP 7a0c0324
Nov 16, 2024 3:43am 0 VERSION_BUMP 31a276f6
Nov 16, 2024 1:27am 0 VERSION_BUMP ebf5d732
Nov 15, 2024 10:40pm 0 VERSION_BUMP ba775f9e
Nov 15, 2024 3:54am 0 VERSION_BUMP 7f22c962
Nov 14, 2024 7:33pm 0 VERSION_BUMP f34bfdb7
Nov 14, 2024 1:00pm 0 VERSION_BUMP b6121078
Nov 14, 2024 6:51am 0 VERSION_BUMP 2e4561d1
Nov 14, 2024 1:01am 0 VERSION_BUMP b394a21c
Nov 13, 2024 9:43pm 0 VERSION_BUMP 7e24ab98
Nov 11, 2024 7:20pm 0 VERSION_BUMP 31930a7a
Nov 11, 2024 6:43pm 0 VERSION_BUMP 0f044f2f
Nov 11, 2024 10:14am 0 VERSION_BUMP 02c426c8
Nov 11, 2024 9:49am 0 VERSION_BUMP 3b4fe144
Nov 10, 2024 12:42pm 0 VERSION_BUMP d2f5c145
Nov 9, 2024 2:17pm 0 VERSION_BUMP f3aca099
Nov 4, 2024 12:50pm 0 VERSION_BUMP bb1a1696
Nov 3, 2024 9:43pm 0 VERSION_BUMP 94dd10eb
Nov 3, 2024 4:26pm 0 VERSION_BUMP 187efe40
Nov 3, 2024 3:43pm 0 VERSION_BUMP 4b42b797
Nov 2, 2024 7:20pm 0 VERSION_BUMP fd710fbd
Nov 2, 2024 6:47pm 0 VERSION_BUMP 28c8ca36
Nov 2, 2024 4:14pm 0 VERSION_BUMP ed9643b5
Oct 31, 2024 9:39pm 0 VERSION_BUMP c036cdbc
Oct 30, 2024 4:31pm 0 VERSION_BUMP 82356c34
Oct 30, 2024 3:50pm 0 VERSION_BUMP 8bd5f712
Oct 30, 2024 4:16am 0 VERSION_BUMP 7081b356
Oct 30, 2024 3:40am 0 VERSION_BUMP f853a98c
Oct 28, 2024 9:41pm 0 VERSION_BUMP dea6dd98
Oct 28, 2024 9:40am 0 VERSION_BUMP 919f5a9b
Oct 27, 2024 9:52pm 0 VERSION_BUMP 27f2c21c
Oct 27, 2024 9:37pm 0 VERSION_BUMP b71ddf58
Oct 26, 2024 9:41am 0 VERSION_BUMP a773ae58
Oct 25, 2024 12:44pm 0 VERSION_BUMP 17884646
Oct 23, 2024 9:40pm 0 VERSION_BUMP 68c2d961
Oct 23, 2024 4:10pm 0 VERSION_BUMP f2be0908
Oct 23, 2024 3:42pm 0 VERSION_BUMP 58e3ab50
Oct 23, 2024 12:30am 0 VERSION_BUMP 3c0c458b
Oct 22, 2024 7:19pm 0 VERSION_BUMP ad44714f
Oct 22, 2024 1:08pm 0 VERSION_BUMP c212a844
Oct 22, 2024 12:26am 0 VERSION_BUMP 9091b072
Oct 13, 2024 7:29pm 0 VERSION_BUMP ecaf0e38
Oct 12, 2024 4:56pm 0 VERSION_BUMP e7497b9c
Oct 12, 2024 3:49pm 0 VERSION_BUMP b34c6180
Oct 12, 2024 11:19am 0 VERSION_BUMP 89645485
Oct 5, 2024 6:40pm 0 VERSION_BUMP 3b6c6dbf
Oct 4, 2024 7:28pm 0 VERSION_BUMP 1d0d16c4
Oct 4, 2024 12:42pm 0 VERSION_BUMP 9361196e
Oct 3, 2024 9:40am 0 VERSION_BUMP 4c277951
Oct 2, 2024 6:40pm 0 VERSION_BUMP c4dc2917
Oct 1, 2024 4:47pm 0 VERSION_BUMP 85200785
Oct 1, 2024 3:24pm 0 VERSION_BUMP 156a313c
Oct 1, 2024 12:49pm 0 VERSION_BUMP 8c74adaa
Sep 30, 2024 11:12pm 0 VERSION_BUMP b8834112
Sep 30, 2024 9:44pm 0 VERSION_BUMP f7a1c914
Sep 30, 2024 1:52pm 0 VERSION_BUMP a66a59dd
Sep 30, 2024 12:47pm 0 VERSION_BUMP 620e9e86
Sep 30, 2024 12:02am 0 VERSION_BUMP 42cfbd70
Sep 29, 2024 4:22pm 0 VERSION_BUMP ede7cb82
Sep 28, 2024 3:39pm 0 VERSION_BUMP 8b702f4b
Sep 28, 2024 2:21pm 0 VERSION_BUMP 2ee68a13
Sep 28, 2024 12:47pm 0 VERSION_BUMP 1fcb7720
Sep 27, 2024 10:26am 0 VERSION_BUMP 2c9aa763
Sep 27, 2024 9:41am 0 VERSION_BUMP 3a283644
Sep 26, 2024 12:43pm 0 VERSION_BUMP 43029a15
Sep 23, 2024 4:40am 0 VERSION_BUMP 2c88f4cc
Sep 22, 2024 8:52pm 0 VERSION_BUMP 60f502a8
Sep 22, 2024 7:09pm 0 VERSION_BUMP b834992f
Sep 22, 2024 6:42pm 0 VERSION_BUMP 063c2a22
Sep 22, 2024 4:28pm 0 VERSION_BUMP d4c247f1
Sep 22, 2024 3:42pm 0 VERSION_BUMP 33a9148b
Sep 21, 2024 3:52pm 0 VERSION_BUMP 8c98aa5a
Sep 20, 2024 11:29pm 0 VERSION_BUMP 06622f0c
Sep 20, 2024 9:42pm 0 VERSION_BUMP c989ed80
Sep 20, 2024 7:33pm 0 VERSION_BUMP 371c79e8
Sep 20, 2024 6:49pm 0 VERSION_BUMP 1569a5bc
Sep 20, 2024 12:44pm 0 VERSION_BUMP c7fb469d
Sep 20, 2024 9:41am 0 VERSION_BUMP 11368d7c
Sep 19, 2024 2:47pm 0 VERSION_BUMP 3bf5926a
Sep 19, 2024 12:43pm 0 VERSION_BUMP 1ff2ecbd
Sep 18, 2024 5:23pm 0 VERSION_BUMP 67055f95
Sep 18, 2024 3:42pm 0 VERSION_BUMP b092427c
Sep 18, 2024 10:48am 0 VERSION_BUMP 0851b792
Sep 18, 2024 12:48am 0 VERSION_BUMP fd8fbcb2
Sep 17, 2024 12:42pm 0 VERSION_BUMP 259d3a28
Sep 17, 2024 9:39am 0 VERSION_BUMP bdbf4eb9
Sep 16, 2024 7:46pm 0 VERSION_BUMP fbda052b
Sep 16, 2024 6:49pm 0 VERSION_BUMP 1bfe761f
Sep 16, 2024 12:51pm 0 VERSION_BUMP 6a6174a0
Sep 14, 2024 5:01pm 0 VERSION_BUMP 239d85ee
Sep 13, 2024 4:13pm 0 VERSION_BUMP 4e21bcc6
Sep 13, 2024 5:27am 0 VERSION_BUMP c949f46e
Sep 12, 2024 10:43pm 0 VERSION_BUMP 54bf542d
Sep 12, 2024 8:20pm 0 VERSION_BUMP 88b42a11
Sep 12, 2024 5:06pm 0 VERSION_BUMP 32615c30
Sep 12, 2024 3:49pm 0 VERSION_BUMP 1abbf9ef
Sep 12, 2024 1:53pm 0 VERSION_BUMP 11d4e601
« Back to VersTracker  |  Browse Packages  |  About