bq2clickhouse is broken

[ryscheng]

Which area(s) are affected? (leave empty if unsure)

No response

To Reproduce

just run any of the jobs

Describe the Bug

logs show a gs://gs://bucket path, so there's so incorrect path construction happening

Expected Behavior

Works

[ryscheng]

Address the path issue here https://github.com/opensource-observer/oso/pull/1836

[ryscheng]

Address secrets management here https://github.com/opensource-observer/oso/pull/1835

[ryscheng]

Address path issue take 2 https://github.com/opensource-observer/oso/pull/1838

There was an issue with how we were deleting blobs

[ryscheng]

One more issue with triple slashes in the path https://github.com/opensource-observer/oso/pull/1839/files

[ryscheng]

Looks like we're really close. Clickhouse has all the marts now, but the jobs are still failing due to a permissions issue with deleting the old GCS blobs

[ryscheng]

On that note, we should get to

• Asset dependencies
• Asset tags While we're at it

[ryscheng]

This is working with @ravenac95 's help fixing up the service account permissions!