Save without index - Githubissues

ynqa / wego

Word Embeddings in Go!

Apache License 2.0

474 stars 41 forks source link

Save without index #18

Closed ynqa closed 7 years ago

ynqa commented 7 years ago

Overview

Save without index:
- before: <word> <index1>:<value1> <index2>:<value2> ...
- after: <word> <value1> <value2> ...

chewxy commented 7 years ago

Is the reason for this smaller binary files?

ynqa commented 7 years ago

Simply set the format the same as original word2vec output. I also thought the indexes of word vector are unnecessary info.

coveralls commented 7 years ago

Coverage remained the same at 49.185% when pulling c5e520b9e688f0f3e67fd9ff822bcc3d88dbc0bb on savewithoutindex into aa1a18baab70b793f88c48f6cda7a4bbe8f1864b on master.

chewxy commented 7 years ago

This way you can just use Gorgonia's serialization methods and dump them

coveralls commented 7 years ago

Coverage remained the same at 49.49% when pulling c9fd2b982b8339bf1c79eec0b7b8ae557fa6ddac on savewithoutindex into 1d350aaa1bd186f344df6b0a15a5698ecb4da364 on master.