search

kmeng01 / rome

Locating and editing factual associations in GPT (NeurIPS 2022)
https://rome.baulab.info
MIT License
572 stars 123 forks source link

CUDA Out of Memory Error on Colab #10

Closed aswathyajith closed 2 years ago

aswathyajith commented 2 years ago

I am trying to run the rome.ipynb on Google Colab and I'm getting an Out of Memory error on the call to demo_model_editing() function call.

kmeng01 commented 2 years ago

Hi @aswathyajith, sorry about the inconvenience! I've fixed the problem; please re-pull, and it should work :)

In case you're curious, the OOM is caused by our recent update to the v* optimization algorithm, which now requires a bit more memory. My fault for not testing the change on the compute-limited Colab servers!

kmeng01 commented 2 years ago

Just confirmed that it's working from a fresh run of the notebook — closing for now, but feel free to re-open if anything comes up!

aswathyajith commented 2 years ago

Thanks, it works now!