I don't know how to apply the output files created by astminer.

tech-srl / code2vec

TensorFlow code for the neural network presented in the paper: "code2vec: Learning Distributed Representations of Code"

https://code2vec.org

MIT License

1.1k stars 286 forks source link

I don't know how to apply the output files created by astminer. #172

Closed Ytz-Ichi closed 1 year ago

Ytz-Ichi commented 2 years ago

I don't know how to apply the output files created by astminer I have generated an intermediate file of C++ source code using astminer, but I don't know what to do from here. The output file structure is as follows:

output/
┗cpp/
　┣data/
　┃┗path_contexts.c2s
　┣node_types.csv
　┣path.csv
　┗tokens.csv

urialon commented 1 year ago

Hi @Ytz-Ichi , Thank you for your interest in our work!

I don't know how to process the output of ASTminer.

However, we have a newer model called PolyCoder: https://github.com/VHellendoorn/Code-LMs

which can be loaded in 2 lines of code using the Huggingface/transformers library.

Best, Uri