Closed shang-zhu closed 11 months ago
Hi @shang-zhu , Thank you for your interest in our work!
What is your pytorch version and transformers version?
Best, Uri
Thank you for your quick reply!
Here is my pytorch and transformers version:
torch 2.1.0 pypi_0 pypi
transformers 4.36.0.dev0 pypi_0 pypi
I actually made it work with the following software version:
pytorch 2.0.1 py3.11_cuda11.7_cudnn8.5.0_0 pytorch
transformers 4.31.0 pypi_0 pypi
Thanks for the help!
Hi thanks for this amazing work.
I followed the installation guide in this issue: #25. but it gives me the following error when running the inference code below on 2 V100 GPUs, each with 32GB:
Error:
Do you know what may go wrong? Thanks.