Move all our data to a proper Delta Lake Database where we can use it in SQL Studio EndPoint in DBX

CDCgov / data-exchange-hl7

Enterprise Data Exchange (DEX) is a new cloud-native centralized data ingestion, validation, and observation service scoped for common data types (HL7, FHIR, CDA, XML, CSV) sent to the CDC. It helps public health stakeholders who send data to the CDC while reducing the maintenance efforts, complexity, and duplication of ingestion points to CDC.

Apache License 2.0

10 stars 14 forks source link

Move all our data to a proper Delta Lake Database where we can use it in SQL Studio EndPoint in DBX #408

Closed mscaldas2012 closed 1 year ago

mscaldas2012 commented 1 year ago

Create a delta Database on our own Storage (ocio-ededev) save all tables on that Database

lmcnabb commented 1 year ago

@raman-cdc need an estimate on this one pls

raman-cdc commented 1 year ago

EDAV asked to add below Service Principal to Storage account. EDAV_DBSQL_ENDPOINT_DEV

Created RITM0086587 for Cloud Service

raman-cdc commented 1 year ago

EDAV added Databricks Admin and Developer AD groups to ocio_dex_dev Database to fix the privileges