google data warehouse etc...

[muf]

• [ ] biq query?

[muf]

ETL ? ELT

https://www.integrate.io/ko/blog/etl-vs-elt-ko/

ETL

E: staging (정제) > T > L > (데이터 웨어하우스)

• 관계형으로 변환 후 활용
• ETL layer example Xplenty, google bigquery, snowflake, redshift..

  ELT

  E > L (replication - 데이터 레이크) > T

• ETL 대비 ELT의 주요 장점으로는 유연성과 새로운 구조화되지 않은 데이터 저장의 용이성이 있습니다

---

ref

• reverse ETL?

  ETL로 뽑은 데이터를 역으로 데이터베이스로 저장하는것 (활용에 맞게)

[muf]

Data Integration

Data integration is the process of taking data from multiple disparate sources and collating it in a single location, such as a data warehouse.

data warehouse?

Data warehouses focus on structured data, while data lakes handle unstructured content. The primary purpose of a data warehouse is to enable companies to access and analyze all of their data to derive the most accurate business insights and forecasting models.

data lake?

data lakehouse...?

Data lakehouses blend the benefits of data lakes and warehouses for versatile data storage.

[muf]

• datastream
• https://cloud.google.com/dataflow?hl=ko
• https://cloud.google.com/data-fusion?utm_source=google&utm_medium=cpc&utm_campaign=japac-SG-all-en-dr-SKWS-all-all-trial-DSA-dr-1605216&utm_content=text-ad-none-none-DEV_c-CRE_655856180768-ADGP_Hybrid+%7C+SKWS+-+BRO+%7C+DSA+-All+Webpages-KWID_39700076131767978-dsa-1456167871416&userloc_9197166-network_g&utm_term=KW_&gad_source=1&gclid=Cj0KCQjwzby1BhCQARIsAJ_0t5MNEQ1rCfcpd3eSbdoyS3iMIEfGA6cGGj29VUpfLBpcbFbrv4XQoVkaAmKPEALw_wcB&gclsrc=aw.ds&hl=ko

[muf]

enrich ?? https://aky123.tistory.com/25