search

ssl-hep / ServiceX_frontend

Client access library for ServiceX
https://servicex-frontend.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
5 stars 11 forks source link

Frontend crashes while working transform is in progress are not saved #468

Closed gordonwatts closed 3 weeks ago

gordonwatts commented 1 month ago

The following sequence:

  1. Your code submits a transform.
  2. While waiting for it to finish, you have a crash or disconnect
  3. Re-run, and a new transform is fired off, even if the old transform is still running and doing just fine.

Expected behavior:

gordonwatts commented 1 month ago

This worked in the 2.0 client, but perhaps this is a non-goal now, @ponyisi ?

The reason it comes up is that sometimes running these really big datasets you can have an hour or more in time, and it is very easy to get a disconnect when that happens.

ponyisi commented 1 month ago

It's a goal but I think we should make it a 3.0.1 or 3.0.2 feature? Basically, look in the local cache for a submitted but not completed transform and recover state from that.

kyungeonchoi commented 1 month ago

I've updated the list for client caching - https://github.com/ssl-hep/ServiceX_frontend/issues/280#issuecomment-2327264275

gordonwatts commented 1 month ago

Feel free to move this to another milestone!