search

archiver-appliance / epicsarchiverap

This is an implementation of an archiver for EPICS control systems that aims to archive millions of PVs.
Other
38 stars 38 forks source link

What is the ETL strategy for data from medium term storage to long term storage? #98

Open HongYi-Shern opened 4 years ago

HongYi-Shern commented 4 years ago

Yesterday it was discovered that the array of disks (LTS) mounted by the archive system was missing, and it was later discovered that the network card communicating with the array was closed. It's not clear how long this has been going on, and will the data still exist if the migration to long-term storage fails? Now reconnect the array, will the medium term storage be moved automatically to the array? Looking forward to your reply!

slacmshankar commented 4 years ago

Unless the appliance is fooled into thinking the data actually moved; the data should be there in the MTS. You can look at the files in the MTS and see how many there are for a PV and determine if the data is still there. And once you reconnect, ETL should transfer to the LTS. I would also take a look at the ETL arch.log to see if any exceptions were reported.