Why does Batch Size matter for AI governance?

Batch size interacts with learning rate — the linear scaling rule says doubling batch size approximately requires doubling learning rate to preserve training dynamics, though this breaks down at extreme scales. Gradient accumulation allows simulating larger batches than fit in memory by accumulating gradients over multiple forward passes before each optimizer step. The platform