Vocabulary of code2vec in dataset

tech-srl / code2vec

TensorFlow code for the neural network presented in the paper: "code2vec: Learning Distributed Representations of Code"

https://code2vec.org

MIT License

1.09k stars 286 forks source link

Open anon721702 opened 3 years ago

anon721702 commented 3 years ago

Dear Sir,

I would like to what exists in the java14m.dict.c2v file in dataset folder. As I am trying to see the content but its encoding is different. Please share file which has normal readable format.
Also, how you have created vocabulary for the same, please elaborate a little.

urialon commented 3 years ago

Hi @anon721702 , Thank you for your interest in code2vec, and sorry for the delayed response.

You can reproduce the way that our code opens this file: https://github.com/tech-srl/code2vec/blob/master/vocabularies.py#L75 to see its content.

Best, Uri

urialon commented 3 years ago

By the way, See our newer code2seq model's demo and code.