Open kamwoh opened 7 months ago
https://discuss.pytorch.org/t/saving-tensor-with-torch-save-uses-too-much-memory/46865/2
saving the text embedding as cache without .clone() will have the file size of whole tensor.
https://discuss.pytorch.org/t/saving-tensor-with-torch-save-uses-too-much-memory/46865/2
saving the text embedding as cache without .clone() will have the file size of whole tensor.