search

ohmeow / ohmeow_website

Apache License 2.0
25 stars 21 forks source link

A small question. #8

Closed ShoubhikBanerjee closed 4 years ago

ShoubhikBanerjee commented 4 years ago

Thanx for your awesome works, I just wanted to know to know that your colab : 2020-05-23-text-generation-with-blurr.ipynb, is it fine tune or pre-training?

ohmeow commented 4 years ago

fine-tuning

I don't have the compute resources to pre-train BART (or most of the other big transformer models) from scratch and so most of my work is really focused on transfer learning and fine-tuning pre-trained models on custom datasets.

ShoubhikBanerjee commented 4 years ago

Thanx for your reply.