Start Pretrained Model Fine-tunning

[hongxuzhou]

• Must start early, at least run the base test out
• Make a clear list of LMs for fine-tuning

[hongxuzhou]

• BERT family
  • basic bert
  • DistillBERT
  • or the one specifies topic modelling -- I forgot the name
• T5