db-wr-common 5 + fulload in transaction

keboola / db-writer-snowflake

Snowflake database writer

MIT License

0 stars 1 forks source link

db-wr-common 5 + fulload in transaction #47

Closed ErikZigo closed 5 years ago

ErikZigo commented 5 years ago

Upgradoval jsem na db-wr-common 5 a full load obalil do transakce

MiroCillik commented 5 years ago

Vyzera to dobre, este by bolo super otestovat ten use case, co popisoval Padak, tzn:

writer zacne zapisovat do tabulky
v druhom vlakne nacitas data z tabulky (nemala by byt dropnuta)
writer dokonci zapis

ErikZigo commented 5 years ago

No to nevim dost dobre jak chces otestovat

MiroCillik commented 5 years ago

Idealne tak, ze spustis zapis velkeho mnozstva dat ako process. A potom druhy process, ktorym spravis ten select? Tie data asi najlepsie nejak vygenerovat.

ErikZigo commented 5 years ago

Tu transakci jsem revertnul. Takze je to jen upgrade na db common 5

https://docs.snowflake.net/manuals/sql-reference/transactions.html

ErikZigo commented 5 years ago

@MiroCillik ^

MiroCillik commented 5 years ago

@ErikZigo a skusal si to? A nefungovalo to?

ErikZigo commented 5 years ago

Jo a rikal to i Martin. Proste ten DROP/CREATE se provede okamzite.

MiroCillik commented 5 years ago

OK, takze to bude treba spravit cez ten truncate s kontrolou a updatom struktury

ErikZigo commented 5 years ago

Presne tak