search

NSSAC / CINES

CINES project repository
Other
1 stars 0 forks source link

running structural analysis jobs on a 10 million node graph #275

Open cckuhlman opened 2 years ago

cckuhlman commented 2 years ago

I created a preferential graph using snap, of 10 million nodes. job ID: eecf58ec-cb92-41eb-83b4-b35c5921d4ac

I am trying to see whether the file got generated correctly, since the structural analysis jobs all failed (more on that below).

So, I went to the first image below, from the job service.

Screen Shot 2021-12-11 at 10 17 40 AM

When I clicked on the top hyperlink under "Output," I got this screen (404 error):

Screen Shot 2021-12-11 at 10 18 01 AM

So link appears to be broken.

Because going through file service, I see the files and info associated with this graph:

Screen Shot 2021-12-11 at 10 20 45 AM Screen Shot 2021-12-11 at 10 21 01 AM Screen Shot 2021-12-11 at 10 21 16 AM
cckuhlman commented 2 years ago

I am at his screen:

Screen Shot 2021-12-11 at 10 24 21 AM

When I go to the upper right, and click "My Jobs," should I not be taken to the home of my jobs?

Either way, attached below is my jobs.

Screen Shot 2021-12-11 at 10 37 34 AM

As the image shows, these four jobs, on the 10 million node preferential attachment graph all fail. I assume that this is because the graph is too big. True? The std out and std error messages I cannot decipher.

One has std out as: "Retrieving file from https://sciduct.bii.virginia.edu/fs/file/dfc7402d-7bd1-4024-8eaf-8d40c9c71df6/1 Staging Failed: Response payload is not completed"

Another has for std out: "Retrieving file from https://sciduct.bii.virginia.edu/fs/file/dfc7402d-7bd1-4024-8eaf-8d40c9c71df6/1 Staging Failed: "

which are not exactly the same.

Now to the structural analysis job errors.

dmachi commented 1 year ago

I fixed a bug that was preventing some large files from being staged. Could you run this test again and see if this problem still exists?