georgian-io / Multimodal-Toolkit

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data
https://multimodal-toolkit.readthedocs.io
Apache License 2.0
587 stars 84 forks source link

Has anyone tried Roberta Base? #17

Closed kaliaanup closed 1 year ago

kaliaanup commented 2 years ago

It gives me classification error. Like one of the class completely blanks out. It does not happen in case of Bert Base.

     precision    recall  f1-score   support

         Yes     0.0000    0.0000    0.0000        63
          No     0.5000    1.0000    0.6667        63
akashsaravanan-georgian commented 1 year ago

Closing this issue as there's not enough information and it's been a year. My guess is that the model either overfit heavily or there's something wonky with the data that caused the model to only predict No.