KeyError: '_data' when training on AWS

anikalburgi
Thu, 19 Aug 2021 16:51:23 +0000

Perfect, Thanks!
This works!
Although, I’m facing CUDA Out of Memory issue with batch size even as low as 8 on p3.2xlarge instance for bert-base-uncased.
Usually, when trained from torch directly and outside sagemaker, the batch size of 14-16 safely works for me on both g4dn.xlarge and p3.2xlarge instances.