src-d / datasets

source{d} datasets ("big code") for source code analysis and machine learning on source code
Other
322 stars 82 forks source link

pga get --stdin file.txt freezes #82

Closed sakalouski closed 6 years ago

sakalouski commented 6 years ago

When I run pga get --stdin file.txt, it freezes after the following messages:

downloading siva files by name from stdin filter flags will be ignored

even if there is only 1 siva file name in the file.txt.

pga get -l python works fine till some point (last time downloaded 10k repos), then freezes. Tried decreasing number of workers to 1 - seemed to stabilize the process to some extent, but I still get this freeze.

Any ideas?

vmarkovtsev commented 6 years ago

@campoy

sakalouski commented 6 years ago

The issue persists. Looking forward to the possible solutions!

campoy commented 6 years ago

Are you sending any content into stdin? You should try cat file.txt | pga get --stdin.