Fix a number of issues with the sync and poll asset workflow after testing in Dagster.
There are still quite a few issues at work but it is at least working in some naive cases now! Will revisit this soon and handle some of the more egregious TODOs I've sprinkled throughout, ie. loads for streams which have had no updates are hanging indefinitely.
There are still quite a few issues at work but it is at least working in some naive cases now! Will revisit this soon and handle some of the more egregious TODOs I've sprinkled throughout, ie. loads for streams which have had no updates are hanging indefinitely.