What is GPTQ?

GPTQ is a one-shot quantization technique introduced by Frantar et al. in 2022 that produces 3-bit or 4-bit quantized LLMs with minimal accuracy loss using approximate second-order information (an approximation of the Hessian). The platform strengthens enterprise readine