What is Llama.cpp?

Llama.cpp is an open-source LLM inference engine written in pure C/C++ by Georgi Gerganov, released in March 2023, that enables CPU and consumer-GPU inference of quantized LLMs with minimal dependencies. The platform strengthens enterprise re