search

dhlee347 / pytorchic-bert

Pytorch Implementation of Google BERT
Apache License 2.0
591 stars 179 forks source link

Running SQUAD #28

Closed ismaeel123 closed 4 years ago

ismaeel123 commented 4 years ago

Can i fune tune this model to make it run squad?

dhlee347 commented 4 years ago

basically yes, but you have to make squad finetuning codes with base bert model.

mineshmathew commented 4 years ago

@dhlee347 Will you be adding code for fine tuning for SQuAD? Do you know any repo (pytorch one ) where I can see how this is done I am a bit confused about how the output layer is set up in case of fine tuning BERT for question answering

Thanks in advance

dhlee347 commented 4 years ago

You can use huggingface/transformers for applying transformers to a variety of NLP tasks