search

facebookresearch / xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.
https://facebookresearch.github.io/xformers/
Other
8.47k stars 603 forks source link

Xformers are slowing down on 3090/4090 #1031

Open rikeLiu opened 5 months ago

rikeLiu commented 5 months ago

❓ Questions and Help

run https://github.com/facebookresearch/xformers/blob/main/xformers/benchmarks/benchmark_transformer.py but more slower. my env: pytorch 2.2.1,cuda 12.1.1 runtime runtime mem

danthe3rd commented 5 months ago

Hi, Can you specify your configuration? Which GPU etc...