When you set the file_format to JSON and complete a DBT run, the JSON files get written to the correct path on S3 however, the glue data catalogue fails to get updated with the new table.
Like when the file_format is parquet or hudi I would expect the process to complete without error and register my new table in the glue data catalogue.
Screenshots and log output
Error returned to the console is:
IllegalArgumentException: Can not create a Path from an empty string
System information
The output of dbt --version:
Core:
- installed: 1.3.0
- latest: 1.3.0 - Up to date!
Plugins:
- redshift: 1.3.0 - Up to date!
- postgres: 1.3.0 - Up to date!
- spark: 1.3.0 - Up to date!
Describe the bug
When you set the file_format to JSON and complete a DBT run, the JSON files get written to the correct path on S3 however, the glue data catalogue fails to get updated with the new table.
Steps To Reproduce
Set the model properties as follows:
Expected behavior
Like when the file_format is parquet or hudi I would expect the process to complete without error and register my new table in the glue data catalogue.
Screenshots and log output
Error returned to the console is: IllegalArgumentException: Can not create a Path from an empty string
System information
The output of
dbt --version
:The operating system you're using:
The output of
python --version
:Additional context
Add any other context about the problem here.