Snowpipe - Bad Snowcat Cloud S3 Events

meltano / squared

Where the Meltano team runs Meltano! Get it???

25 stars 6 forks source link

Snowpipe - Bad Snowcat Cloud S3 Events #254

Open pnadolny13 opened 2 years ago

pnadolny13 commented 2 years ago

Theres a bug with the Snowpipe for Snowcat Cloud data coming into the bad S3 prefix. The snowpipe copy command works as expected but the notifications when files land dont seem to be triggering properly.

aaronsteers commented 2 years ago

@pnadolny13 - Is this resolved as of now or do we still need to take action in #258 ?

pnadolny13 commented 2 years ago

@aaronsteers its technically resolved because I manually added the notification to the S3 bucket using the aws console but I did want to get that transitioned under Terraform's management. I think the changes in https://github.com/meltano/squared/pull/258 would do it but I didnt feel comfortable hitting apply when I saw the diff and thought Ken could be able to interpret it easier.