Arora debug notes and TODOs

fortytw0 / needfinder

Cheap and Fast - But is it better?

MIT License

1 stars 0 forks source link

Arora debug notes and TODOs #6

Open AbeHandler opened 2 years ago

AbeHandler commented 2 years ago

[x] Get config’s files working, include config in file name
[ ] Do you see the weird distribution with glove or just with w2v, waiting on #7
[ ] How correlated are Sbert and arora predictions?
[ ] PCA + w2v. I bet many vectors are in the same portion of the space.
[ ] Try different values of alpha.
[ ] Try mittens, waiting on #7

AbeHandler commented 2 years ago

This weird distribution is only for w2v not pretrained glove. This suggests there is an issue w/ the w2v learning. Maybe we don't have enough data for w2v. This is something to discuss.