search

MeltanoLabs / target-athena

Singer.io Target for AWS Athena.
Other
5 stars 16 forks source link

Verify compression is being handled correctly #8

Closed andrewcstewart closed 3 years ago

andrewcstewart commented 3 years ago

From @aaronsteers

One other bug I think I found, which I didn’t document, was that I wasn’t sure if the compression was getting handed off to Athena properly. I think my first attempt with compression made the target table unreadable. I just turned it off without much further testing, but if we want to do jsonl/json, the compression would probably come up there also.

andrewcstewart commented 3 years ago

I believe this is working fine, the issue encountered before was just due to file type suffix mismatches.