Recreating the schema and tables on every load means also updating grants for application roles. Therefore, errors on refresh currently break any downstream applications.
To fix:
create all empty bcfishobs relations on setup (only run once)
download and run processing in temp schema
flush data to bcfishobs only on successful completion of entire load
Recreating the schema and tables on every load means also updating grants for application roles. Therefore, errors on refresh currently break any downstream applications. To fix:
bcfishobs
relations on setup (only run once)bcfishobs
only on successful completion of entire load