iris-hep / idap-200gbps-atlas

benchmarking throughput with PHYSLITE
6 stars 1 forks source link

Why are some files missed in SX when the query completes? #59

Closed gordonwatts closed 4 months ago

gordonwatts commented 4 months ago

Even with small submissions sometimes there are 4 files, but the client only sees 2. It started happening this week.

This might have to do with the elimination of the 10 second sleep in SX between the last "done" message and actually declaring the transform done.

gordonwatts commented 4 months ago

This seems to have gotten better. Will close this until it reappears.