aws-samples / aws-glue-samples

AWS Glue code samples
MIT No Attribution
1.42k stars 812 forks source link

writing data to s3 using spark and updating catalog #152

Open lucaszago opened 7 months ago

lucaszago commented 7 months ago

I'm working in a glue job and I want to reflect my appended data when I query into Athena what are the options considering I'm writing like : df.write.mode("append").partitionBy(*cols).parquet(path)? I would be glad with some help here