Data pipeline for EDA/Processing - Githubissues

sayantikabanik / capstone_isb

Using a combination of multiple facets of Health, Engagement and Productivity to estimate occupational burnout

Other

1 stars 1 forks source link

Data pipeline for EDA/Processing #17

Closed sayantikabanik closed 2 years ago

sayantikabanik commented 2 years ago

Based on the discussion today morning the next steps are toward introducing standardization and reproducibility.

@sahithi02 @AnizD would be requiring all the components for the insights into python scripts

⚙️ Steps forward:

Grunt work
Getting all the components together
Preprocessing pipeline + CLI inputs
Post-processing logic
business logic
Basic testing
Advance code testing (if time permits)
Report generation

🛠 Tools/packages

Dagster
Pytests

⏰ Timelines

To be completed before 10th July

sayantikabanik commented 2 years ago

@sayantikabanik added dagster pipeline

sayantikabanik commented 2 years ago

Testing framework added for future additions