[Indexer] Which ETL to use

[RienderieN]

Given an open source and free ETL When we load/filter/transform/mapp board game data from BoardGameGeek's api Which ETL will be better for our requirements in order to facilitate maintainability and manageability of data source.

[RienderieN]

After try several ETL, apache NIFI and Camel were selected:

• Apache NIFI is easy to use but we haven't the hand on the process to made some UT et IT. Moreover, using NIFI is like take out the tank compared to ours requirements.
• Camel is perfect but currently we have only one type resource (api rest) and it wont be necessary to use camel in first time

In conclusion, for a first draft we can use spring boot with spring batch with paralelling processing multi step. In ours resource changes, like csv or other types, a migration of steps to camel will be easy

[MagicSoup]

It's ok for me