We need to refactor the pipeline components to manage the components' parameters and options as one config object specific to each component. This config object should also take care of checking parameters and options.
We already implemented an example for the TokenSelectorDataPreprocessing preprocessing component, see:
We need to refactor the pipeline components to manage the components' parameters and options as one config object specific to each component. This config object should also take care of checking parameters and options.
We already implemented an example for the
TokenSelectorDataPreprocessing
preprocessing component, see:olaf/pipeline/data_preprocessing/token_selector_data_preprocessing.py
olaf\pipeline/data_preprocessing/data_preprocessing_schema.py
test/pipeline/data_preprocessing/test_token_selector.py
Don't forget to update the corresponding tests.
We leverage Python dataclasses. See the following resources for details: