Clone of gpytorch PR: https://github.com/cornellius-gp/gpytorch/pull/1394 so that its not forgotten. I can add it in for PSDLinearOperators later.