Reorder the Transformers

gisaia / ARLAS-proc

Workaround about data ingestion with computing frameworks

Apache License 2.0

4 stars 0 forks source link

Reorder the Transformers #84

Closed laurent-thiebaud-gisaia closed 4 years ago

laurent-thiebaud-gisaia commented 5 years ago

The transformers folder is get messy. Transformers within the same hierarchy should be put in dedicated folders. Transformers that are customer-specific should be put in the customer specific project (this may be checked with data scientists).

sfalquier commented 4 years ago

We should dispatch transformers into the following sub-packages :

ml : transformers that requires ARLAS-ml stuff
timeseries : transformers that deals with states and ids
features : transformers that compute new features (distance, speed, ...)
tools : transformers that perform basic operations on the dataframe (value replacement, colonne mapping, ...)
misc : other transformers