search

yya518 / FinBERT

A Pretrained BERT Model for Financial Communications. https://arxiv.org/abs/2006.08097
Apache License 2.0
560 stars 128 forks source link

FinBERT pipeline vs Finbert Model Example code result difference #22

Closed eadsa1998 closed 2 years ago

eadsa1998 commented 3 years ago

My collaborators and I were experimenting with FinBERT by comparing the results of your code from the Finbert Model Example notebook to the results of using the transformer code in a HuggingFace pipeline. of the 7 we tested it on, all came out with different scores, but 3 came out with different labels altogether. We were wondering if you knew what the reason for that might be? I can upload the code that we used if that would be helpful.

yya518 commented 3 years ago

Could you be more specific? Are you saying that our notebook, or transformer's pipeline, produces different scores? and 7 of what? sentences?