search

Rucal-Data-Solutions / datalakefoundation

Datalakehouse Foundation
GNU General Public License v3.0
3 stars 0 forks source link

Default behavior schema drift in processing #27

Closed Gateway1024 closed 4 months ago

Gateway1024 commented 5 months ago

The schema drift is dependent on the spark setting 'spark.databricks.delta.schema.autoMerge.enabled' this is not a problem but we should be able to set this behavior on the connection/entity