awslabs/keys_values

Is your feature request related to a problem? Please describe. We replaced DataLoader with a simple MyDataLoader, which uses our specific batch sampler as it should be (the PyTorch data loader accesses the batch sampler more than it should). Our batch sampler caters correctly for…

Is your feature request related to a problem? Please describe. There is currently no test to quantify the error in gradients introduced by different approximations, e.g.: Quantization of activation checkpoints Cell-based computation [any?] Autograd saved tensors packing [any?]…