Where is Gradient Checkpointing used in practice?

Combined with mixed precision training, QLoRA, and FSDP, gradient checkpointing enables fine-tuning of 70B-parameter models on hardware that would otherwise require eight times more memory. AI governance teams encounter gradient checkpointing mainly in training pipeline configuration; it does not affect deployed model behavior, only training memory profile and training time.