search

dhlee347 / pytorchic-bert

Pytorch Implementation of Google BERT
Apache License 2.0
589 stars 181 forks source link

Question About fine-tuning #9

Closed graykode closed 5 years ago

graykode commented 5 years ago

https://github.com/dhlee347/pytorchic-bert/blob/master/classify.py#L137 When fine-tuning, is there no needed '[SEP]', '[CLS]'? In google-research code, They add 'CLS' and 'SEP' in fine-tuning. https://github.com/santhoshkolloju/Abstractive-Summarization-With-Transfer-Learning/blob/master/preprocess.py#L197

dhlee347 commented 5 years ago

Sorry for the late response, '[SEP]', '[CLS]' are added at https://github.com/dhlee347/pytorchic-bert/blob/master/classify.py#L119