Use the "[CLS]" instead of pooled result?

strongio / keras-bert

A simple technique to integrate BERT from tf hub to keras

258 stars 108 forks source link

Use the "[CLS]" instead of pooled result? #34

Open isunli opened 4 years ago

isunli commented 4 years ago

I don't know if I am get this correct. According to the BERT paper, author mentioned to use the first vector to do a classification ("[CLS]"). I saw you are using "pooled" vector in your code. Is there any reason?

Thanks, Li Sun