How to use Bert to calculate the PPL of a sentence

jina-ai / clip-as-service

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

https://clip-as-service.jina.ai

Other

12.4k stars 2.07k forks source link

Open xiaobengou01 opened 5 years ago

xiaobengou01 commented 5 years ago

Prerequisites

Please fill in by replacing [ ] with [x].

[x] Are you running the latest bert-as-service? [x]Did you follow the installation and the usage instructions in README.md? [x] Did you check the FAQ list in README.md? *[x]Did you perform a cursory search on existing issues? ... How to use bert to calculate the probability of a sentence，just like this feature of Baidu http://ai.baidu.com/tech/nlp_basic/dnnlm_cn

...

Bachstelze commented 5 years ago

You could try BERT as a language model. As far as i know doesn't BERT as a service support the calculation of the word probability.