search

cms-sw / cmssw

CMS Offline Software
http://cms-sw.github.io/
Apache License 2.0
1.07k stars 4.28k forks source link

Improving XrdAdaptor with the retry algorithm #42056

Open bockjoo opened 1 year ago

bockjoo commented 1 year ago

In view of the conversation in https://cms-talk.web.cern.ch/t/not-possible-to-open-2022g-data-files-crab-or-manual-xroot/25738/38 , it would be desirable to have an additional retry algorithm in accessing xrootd servers in addition to the current one. For example, one could think of the sitename based retry in addition to the current hostname based xrootd retry. In this way, users can choose a different way to access xrootd servers and this would help particularly if a site is suffering file loss.

cmsbuild commented 1 year ago

A new Issue was created by @bockjoo Bockjoo Kim.

@Dr15Jones, @perrotta, @dpiparo, @rappoccio, @makortel, @smuzaffar can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

makortel commented 1 year ago

assign core

cmsbuild commented 1 year ago

New categories assigned: core

@Dr15Jones,@smuzaffar,@makortel you have been requested to review this Pull request/Issue and eventually sign? Thanks

makortel commented 1 year ago

Tagging @bbockelm @osschar as "random" people who know something about xrootd

makortel commented 1 year ago

For future reference the retry logic in question is in https://github.com/cms-sw/cmssw/blob/8ea0010836fb790004c272ee467d763a9bf71468/Utilities/XrdAdaptor/src/XrdRequestManager.cc#L196-L266