MeltanoLabs / tap-snowflake

Other
4 stars 9 forks source link

Ability to Run Various Snowflake Op Commands #33

Open wesseljt opened 1 year ago

wesseljt commented 1 year ago

I'm thinking of a use case where I want to unload data from snowflake to s3 -- but I don't want to pull the files locally first. I would want meltano to be able to issue something like:

COPY INTO X @Stage from table1
COPY INTO X @Stage from table2
COPY INTO X @Stage from table3
COPY INTO X @Stage from table4
etc.

then return some kind of success or failure after the command completes in snowflake. I'm currently planning to do this by scheduling tasks in snowflake - but would love the visibility of having this in meltano.