wikit-ai / olaf

6 stars 1 forks source link

refactor: manage pipeline components' parameters and options as a Config object #23

Closed ba-talibe closed 5 months ago

ba-talibe commented 5 months ago

We need to refactor the pipeline components to manage the components' parameters and options as one config object specific to each component. This config object should also take care of checking parameters and options.

We already implemented an example for the TokenSelectorDataPreprocessing preprocessing component, see:

Don't forget to update the corresponding tests.

We leverage Python dataclasses. See the following resources for details: