C10-Brazilian-e-commerce-modeling-team / brazilian-e-commerce

0 stars 6 forks source link

chore: define ETL process to integrate scrapper, the NLP and the dashboard #71

Closed elyager closed 2 years ago

felipesaldata commented 2 years ago

We had a meeting on saturday and define to work with airflow in order to script continuously our datamodel and integrate the whole functionality of our project.

Having this clear, we made an update to the datamodel visualization.

We also need to modularizate our scripts and apply the best practices to integrate all the steps.