Open chenbinghui1 opened 5 months ago
When I replace the attn processor with this project, I find the used GPU memory will be increased. Who knows the reason?
Have you tried torch.cuda.empty_cache() ?
torch.cuda.empty_cache()
When I replace the attn processor with this project, I find the used GPU memory will be increased. Who knows the reason?