Drop Table events are not captured.

awslabs / aws-glue-catalog-sync-agent-for-hive

Enables synchronizing metadata changes (Create/Drop table/partition) from Hive Metastore to AWS Glue Data Catalog

Apache License 2.0

33 stars 13 forks source link

Drop Table events are not captured. #1

Open shreya668 opened 5 years ago

shreya668 commented 5 years ago

I was trying aws-glue-catalog-sync on an emr cluster. I see that create/add partition events are captured and corresponding queries are passed to athena query processor. But the drop table/partition events are not working.

Also in the code I see, these events are not implemented. Is there any specific reason, we are not capturing them or are there any plans to implement them in future.

IanMeyers commented 5 years ago

Hi @shreya668. Thanks for the note. They are not implemented yet, but certainly can be without too much trouble. We need to add some mechanism by which customers can selectively turn this on and off. Can you elaborate what you'd like the behaviour to be for these events so we can scope out what it would take to implement it?