Make improvements to BERT sentiment model - Githubissues

TheRensselaerIDEA / twitter-nlp

Data Analytics on Twitter with Natural Language Processing

MIT License

17 stars 7 forks source link

Make improvements to BERT sentiment model #49

Closed shwehtom89 closed 3 years ago

shwehtom89 commented 3 years ago

This PR adds numerous iterations on top of the existing BERT sentiment classification pipeline

Update tokenization to use latest HuggingFace APIs
Create main training loop for the model
Monitor the average loss and logits of the model
Adds a validation step for each epoch of training
Upload the pytorch model to Dropbox in case the runtime disconnects
Evaluate model on the testing set at the end of training