This PR is the first part of a re-architecture that is attempting to improve the extensibility of Hauser. The tasks of downloading, decoding, grouping, and saving the FullStory event exports are separated out into separate stages of a Pipeline. The output of the Pipeline is a filename and the corresponding bundle metadata. This is all that's needed to pass to the Warehouse in order upload to the database or bucket storage.
While this PR doesn't make any significant changes to the Hauser feature set, it does enable flexibility in each of the processing steps.
This PR is the first part of a re-architecture that is attempting to improve the extensibility of Hauser. The tasks of downloading, decoding, grouping, and saving the FullStory event exports are separated out into separate stages of a
Pipeline
. The output of thePipeline
is a filename and the corresponding bundle metadata. This is all that's needed to pass to theWarehouse
in order upload to the database or bucket storage.While this PR doesn't make any significant changes to the
Hauser
feature set, it does enable flexibility in each of the processing steps.