Client-side Caching

[gordonwatts]

• Caching code needs testing coverage
• Code must be robust against crashes and network loss mid-transform
• Robust against switching between download files and signed url

[kyungeonchoi]

Github issues on caching

Bug

• https://github.com/iris-hep/idap-200gbps-atlas/issues/135
• https://github.com/ssl-hep/ServiceX_frontend/issues/375
• https://github.com/ssl-hep/ServiceX_frontend/issues/418
• https://github.com/ssl-hep/ServiceX_frontend/issues/213
• https://github.com/ssl-hep/ServiceX_frontend/issues/396
• https://github.com/ssl-hep/ServiceX_frontend/issues/361
• https://github.com/ssl-hep/ServiceX_frontend/issues/285
• https://github.com/ssl-hep/ServiceX_frontend/issues/295

Feature

• https://github.com/ssl-hep/ServiceX_frontend/issues/383
• https://github.com/ssl-hep/ServiceX_frontend/issues/468
• https://github.com/ssl-hep/ServiceX_frontend/issues/280 (This one)

Working branches

• https://github.com/ssl-hep/ServiceX_frontend/pull/318
  • Solve #361

Wish list for 3.0

• Code must be robust against crashes and network loss mid-transform (Gordon) #468
• Robust against switching between download files and signed url (Gordon)
• Caching code needs testing coverage (Gordon)
• Download to non-temporary space (KyungEon)