data data process

[getElementsByName]

overall flow

https://www.cc-cdq.ch/managing-big-data-and-analytics https://ikkison.tistory.com/69

streaming / batch

• https://www.oreilly.com/content/ubers-case-for-incremental-processing-on-hadoop/
• https://www.soscon.net/content/data/session/Day%202_1730_2.pdf

[getElementsByName]

Data onboarding process

source db - [source connector (debezium)] - queue(kafka) - [sink connector(kafka consumer)] - hdfs

Analytics delivery process

[OLAP - schema (airflow dags)] - hive