CAnBioNet / TkNA

9 stars 1 forks source link

"EOFError: Ran out of input" during Compute Network Stats #10

Closed Sankalpsp21 closed 1 year ago

Sankalpsp21 commented 1 year ago

I'm getting an error while running the step "compute_network_stats.py"

image

Here are the command and files I used for this step:

"python random_networks/compute_network_stats.py --networks-file nashOutput/networkOutput/all_random_nws.pickle --bibc-groups node_types --bibc-calc-type rbc --stats-file all_rand_network_results.pickle --node-map /nfs3/PHARM/Morgun_Lab/amanda/network_analysis_NWcode/network_calculations/nash_2-23-23/input_2/nash_type_map.csv --node-groups plasma_anthro lipid_metab"

nash_type_map.csv

all_rand_network_results.pickle

bruceamm commented 1 year ago

I'm running into the same issue. We are attempting to create large random networks of 6101 nodes and 108858 edges.

Traceback (most recent call last): File "/nfs3/PHARM/Morgun_Lab/amanda/network_analysis_NWcode/network_calculations/random_networks/create_random_networks.py", line 95, in pickle.dump(networks, networksFile) _pickle.PicklingError: memo id too large for LONG_BINGET Traceback (most recent call last): File "/nfs3/PHARM/Morgun_Lab/amanda/network_analysis_NWcode/network_calculations/random_networks/compute_network_stats.py", line 129, in networks = pickle.load(networksFile) EOFError: Ran out of input Traceback (most recent call last): File "/nfs3/PHARM/Morgun_Lab/amanda/network_analysis_NWcode/network_calculations/random_networks/synthesize_network_stats.py", line 35, in args = getArgs() File "/nfs3/PHARM/Morgun_Lab/amanda/network_analysis_NWcode/network_calculations/random_networks/synthesize_network_stats.py", line 20, in getArgs raise Exception("Specified network stats file does not exist") Exception: Specified network stats file does not exist

newmanno commented 1 year ago

This is likely a memory issue, as it only seems to happen with large networks. We will look into this more.