search

databricks-demos / dbdemos

Demos to implement your Databricks Lakehouse
Other
255 stars 80 forks source link

dlt demo is failing in Initialization state. #58

Open immsgbb opened 10 months ago

immsgbb commented 10 months ago

Incompatible format detected.

A transaction log for Delta was found at //_delta_log, but you are trying to read from /databricks-datasets/lending-club-loan-stats using format("csv"). You must use 'format("delta")' when reading and writing to a delta table.

To disable this check, SET spark.databricks.delta.formatCheck.enabled=false To learn more about Delta, see https://docs.microsoft.com/azure/databricks/delta/index,None,Map(),Map(),List(),List(),Map())

Why don't we make we this in all the demo as default when we need to read JSON or some other formats.

SET spark.databricks.delta.formatCheck.enabled=false