search

facebookresearch / deepcluster

Deep Clustering for Unsupervised Learning of Visual Features
Other
1.68k stars 324 forks source link

Where to get good init embedding for text? #69

Closed guotong1988 closed 4 years ago

guotong1988 commented 4 years ago

If we want to use deepcluster for text, the problem for text is how to get the init embedding from deep model. BERT can not get good init embedding.

mathildecaron31 commented 4 years ago

Hi, I'm sorry I cannot answer this question because I've only experimented with self-supervised models on images and not on text.