namiyousef / multi-task-learning

Repository for multi task learning
2 stars 2 forks source link

Get model running on UCL GPU cluster #4

Closed namiyousef closed 2 years ago

namiyousef commented 2 years ago

Performance of models is very slow. GPU computation will greatly help with this. Priority:

namiyousef commented 2 years ago

How to run Google Colab notebook

1) Upload the .ipynb notebook to Google colab 2) BEFORE RUNNING NOTEBOOK: change the runtime to GPU runtime. There is a runtime button on the notebook menu. Click, then go down to 'change runtime type' and select GPU 3) follow the instructions in the cells

namiyousef commented 2 years ago

Performance gains with GPU:

WITH: single minibatch takes ~ 0.73 seconds on colab WITHOUT: single minibatch takes ~ 14 seconds on Colab

Very promising results. The only concerned we may have are that Colab may cause issues if run for a long time / memory gets full (although I don't see a reason for this).