search

iris-hep / idap-200gbps-atlas

benchmarking throughput with PHYSLITE
6 stars 1 forks source link

Test fsspec-xrootd v0.3.0 #54

Closed alexander-held closed 6 months ago

alexander-held commented 6 months ago

We regularly see reading errors that xrootd related. The latest release of fsspec may help with this, so try it out. Requires a new image https://github.com/usatlas/analysisbase-dask/issues/41.

matthewfeickert commented 6 months ago

fsspec-xrootd v0.3.0 is now available on AB-dev:

https://github.com/usatlas/analysisbase-dask/issues/41#issuecomment-2068522806

gordonwatts commented 6 months ago

I think this is finished, @alexander-held - could we quickly write up the results? Or if it isn't, bounce forward to week 5?

alexander-held commented 6 months ago

The version update was done. I did not see any significant changes. We did not do a closer benchmark comparison, my main hope was that this may help with reading errors. We still see reading errors, I cannot exclude that they happen less than before but we did not compare quantitatively. I think we can close this as done, we have no reason to not use this version.