[x] When adding to the local partitioned datasets with update_daily() and update_hourly(), only the current partition (currently 'year') needs to be collect()ed and combined with the new data before writing to disk
[x] Targets that write to datasets should be set to not run on workers with deployment = "main" so tar_make_clustermq() can work (currently hangs).
[ ] Datasets can be more finely partitioned into month nested within year---I think this will speed things up, especially for the hourly data.
update_daily()andupdate_hourly(), only the current partition (currently 'year') needs to becollect()ed and combined with the new data before writing to diskdeployment = "main"sotar_make_clustermq()can work (currently hangs).