stfc / ral-htcondor-tools

Scripts and stuff used with HTCondor at RAL
0 stars 7 forks source link

Increase xrootd stream timeout #52

Closed alex-rg closed 8 months ago

alex-rg commented 1 year ago

For effective operation of vector read requests stream tiemout should be increased, default value (1 minute) is not enough. There are two reasons for this:

  1. Sometimes ceph operations can take longer than one minute. This is especially true for unhealty cluster.
  2. With the prefetch off xrootd services are less "tolerant" to restarts. This is because proxy usually recovers faster after the restart. Since client talks to proxy, when it is covered it will immediately request new data. With prefetch off this data is unlikely to be present in local cache, therefore requests is likely to be forwarded to gateway. Since gateway usually requires more time to recover, default timeout may be exceeded.