Closed dongfeng3692 closed 9 months ago
the uuid is to avoid collision (multiple runs in the cloud). You should already be able to set a s3 prefix, you can change it to yyyy-mm-dd/ and the prefix is going to up to be yyyy-mm-dd/
Thank you @smoy for the suggestion. Yes, a dated prefix can be added to the tempdir
parameter like so and the uuid will be appended after it:
.option("tempdir", "s3n://mybucket/yyyy-mm-dd")
Sometimes I may want to use historical s3 files to restore redshift's historical data, but uuid makes it difficult for me to quickly find the version I want。