Hi,
I am just trying to run the demo and running the generate.py but getting out of memory for cuda error. I reduced the batch size for model and generation in default.yaml but in vain.
Which GPU card you have used and what was the RAM? Did you get the such issue?
irum
commented
1 year ago
Hi, I am just trying to run the demo and running the generate.py but getting out of memory for cuda error. I reduced the batch size for model and generation in default.yaml but in vain. Which GPU card you have used and what was the RAM? Did you get the such issue?