Activation Recomputation: When Saving Memory Costs You More Than You Think
Activation recomputation trades GPU memory for extra compute during training. Here's when that tradeoff works, when it breaks, and how to tune it.
Magos Veridian
· · 4 min read