This PR abstracts out the data set processing part of the DataSetDownloader into a separate trait.
There are two implementers, FileSinkClient and NopDataSetProcessor.
This is so that the DataSetDownloader can be used without processing the data.
The implementer of this trait being FileSinkClient is because you would only want to supply a file sink if you are processing the data.
This PR abstracts out the data set processing part of the
DataSetDownloader
into a separate trait. There are two implementers,FileSinkClient
andNopDataSetProcessor
. This is so that theDataSetDownloader
can be used without processing the data. The implementer of this trait beingFileSinkClient
is because you would only want to supply a file sink if you are processing the data.