search

lucidrains / x-transformers

A concise but complete full-attention transformer with a set of promising experimental features from various papers
MIT License
4.63k stars 395 forks source link

Pytorch warning with autocast #265

Closed pfeatherstone closed 1 month ago

pfeatherstone commented 2 months ago

With latest Pytorch version i'm getting the warning:

FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead
lucidrains commented 1 month ago

how far back in torch versions does this work?