Where is Adam Optimizer used in practice?

Adam's main drawback is memory cost — it requires two extra state tensors per trainable parameter, contributing significantly to fine-tuning memory budgets. AI governance teams document optimizer choice in their training lineage. The pla