For machine learning engineers working with Nvidia GPUs, the dreaded "CUDA out of memory" error can be a constant source of frustration.