Open ashwath98 opened 4 years ago
I would recommend to create info.csv on local system and then upload it to google colab. Make sure the file structure remains same other you might end up in discrepancies between files.
when i am running create_info.py, this problem happened
I'm running your code on google colab. when I execute the scripts to generate the CSV file, I got the warning: [tcmalloc: large alloc 2392449024 bytes] before the system crashed which is probably due to memory allocation exceeding the colab limit of 20GB
do you have any suggestions to reduce the memory requirements of the create_info script