Incompatible with python deltalake 0.20.0

[sushi30]

Affected module Ingestion

Describe the bug Deltalake 0.20.0 introduces an exception when a table is loaded without files. This is incopmatible with how OMD's ingestion framework reads the file.

To Reproduce

1. pip install 'openmetadata-ingestion[deltalake]' 'deltalake>=0.20.0'
2. try to ingest deltalake.
3. tables will not be loaded

Expected behavior

step 3 should produce tables.

Version:

• OS: [e.g. iOS]
• Python version:
• OpenMetadata version: main (ec6a6622022a18c14e269e2fc9931bc3ab4c3154)
• OpenMetadata Ingestion package version: [e.g. openmetadata-ingestion[docker]==XYZ]

Additional context Add any other context about the problem here.