dataform-co / dataform-bqml

Apache License 2.0
3 stars 3 forks source link

Full refresh not working #6

Open mortie23 opened 2 months ago

mortie23 commented 2 months ago

Hello, I may not be using this correct, but when I make a change to my prompt that requires a full refresh it doesn't seem to we working. So far I am manually having to drop all tables that are managed by BQML and anything downstream.

mortie23 commented 2 months ago

Will close this as my assumption of " I may not be using this correct " is most likely.

mortie23 commented 3 weeks ago

Hello @chtyim, I am still having issues with any workflow executation with the "run with full refresh" option. In theory, I would expect that if I select all actions for the workflow execution, and then select "run with full refresh", that it would delete all records from the bqml managed tables and send all records to the ML.GENERATE_TEXT again.

This doesn't seem to be the current functionality, and I am having to manually DROP all tables when I need a full refresh.

Appreciate any help or advice