ORNL / DataFed

A Federated Scientific Data Management System
https://ornl.github.io/DataFed/
Other
18 stars 14 forks source link

System - Publish data is broken #271

Closed dvstans closed 3 years ago

dvstans commented 4 years ago

Current implementation allows user to edit a record to change from managed data to externally published HTTP data; however, no consideration is given to running tasks that may be accessing the associated raw data, owner, or allocation. Publishing data is a destructive event and must fully isolated from other running tasks. Existing and subsequent read tasks may fail by not seeing the correct data location, so publishing data should be treated like a "delete" operation - i.e. not allowed to run concurrently with any other tasks, and should be handled immediately, rather than as a background task (file delete task would still be created).

dvstans commented 4 years ago

Defer until publication support is added

dvstans commented 3 years ago

This is obsolete - publishing not supported