This needs to monitor a file system and track for any change in terms of new file creation / modification.
A script runs on some interval which checks for the new files and take all the files which are yet to be processed. This script should call the main pipeline and execute the stages required
Currently discussed stages:
Open Raw
Compute Sv -> append Sv to existing Sv store and have a roll over to decide when to have the next file
Compute MVBS -> append MVBS to existing MVBS store and have a roll over to decide when to have the next file
Pipeline to be executed on ship
Open RawCompute Sv-> append Sv to existing Sv store and have a roll over to decide when to have the next fileCompute MVBS-> append MVBS to existing MVBS store and have a roll over to decide when to have the next fileML Mask PredictionCompute NASC