dremio-professional-services / dremio-cloner

27 stars 20 forks source link

reproduce and fix ordering issue for "separate_sql_and_metadata_files": true configuration #53

Open mxmarg opened 2 months ago

mxmarg commented 2 months ago

In one customer case with multiple nested folder structures, reading separate SQL and metadata files for Dremio objects did not work correctly and resulted in KeyError: 'sql' in Python or Virtual Dataset must have sql defined errors from Dremio's REST API.

The current workaround is to avoid using the configuration "separate_sql_and_metadata_files": true for complex folder structures.