Open Pangjing-Wu opened 5 months ago
In the data preprocessing part, did you use 200G of RAM to process one-tenth of the data?
I can completely load the data with about 120G RAM
Did you handle this with unmodified code, or did you modify the code to load the relationships between different files in sequence?
In the data preprocessing part, did you use 200G of RAM to process one-tenth of the data?