How to get token level embedding?

amansrivastava17 / embedding-as-service

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

MIT License

204 stars 29 forks source link

Closed vasampaio closed 4 years ago

vasampaio commented 4 years ago

Using the pooling strategy i can get the first or the last token, how do I get a token embedding for all the tokens in a sentence?

ashutoshsingh0223 commented 4 years ago

Set pooling to None.