Create TSNE plot of individual job descriptions

MouseAndKeyboard / LanguageModels

Document classification exploration

1 stars 0 forks source link

Open MouseAndKeyboard opened 2 years ago

MouseAndKeyboard commented 2 years ago

[x] 1. Use Gensim to train word embeddings (why can't we just use pre-trained word embeddings? Maybe we ask Wei if we can just use pretrained word2vec)
[ ] 2. Take individual job descriptions for particular jobs, embed their tokens, then visualise all the vectors using TSNE.

MouseAndKeyboard commented 2 years ago

Perhaps we could consider using BERT word embeddings for improved performance. This could also grant us bonus marks

MouseAndKeyboard commented 2 years ago

Perhaps we could consider using BERT word embeddings for improved performance. This could also grant us bonus marks

nvm this not allowed