I opened this PR but don't intend to merge it. The goal is just to run with larger sd on a subset and compare benchmark performance to motivate adjusting the default parameters in wwinferece.
Another fun targets interacts with containers wrinkle-- if you run a large targets pipeline and then try to build a container (as I was trying to do on a different branch) the targets are part of the container build. I got this error after running our post-processing pipeline:
Error: error committing container for step {Env:[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin LC_ALL=en_US.UTF-8 LANG=en_US.UTF-8 R_BASE_VERSION=4.4.0 R_BUILD_REPOS='https://packagemanager.posit.co/cran/__linux__/jammy/latest'] Command:add Args:[. /.] Flags:[] Attrs:map[] Message:ADD . /. Original:ADD . /.}: error copying layers and metadata for container "18ea2ff4228380c0c66d8e5c6b3cea9b13842feaf04ee84e5255bd52dc18dafd": writing blob: adding layer with blob "sha256:be3fd3f85c73062c76623962c512c311d42c52bead4d0ceb7510f77fcb53b188": Error processing tar file(exit status 1): write /_targets/objects/fig3_forecast_comparison_1wk3: no space left on device
Worked fine after I tar_destroy()ed, but of course, thats not the point of targets (I should be able to switch branches, run something, come back to that branch and work with outputs...
I opened this PR but don't intend to merge it. The goal is just to run with larger sd on a subset and compare benchmark performance to motivate adjusting the default parameters in
wwinferece
. Another fun targets interacts with containers wrinkle-- if you run a large targets pipeline and then try to build a container (as I was trying to do on a different branch) the targets are part of the container build. I got this error after running our post-processing pipeline:Worked fine after I
tar_destroy()
ed, but of course, thats not the point of targets (I should be able to switch branches, run something, come back to that branch and work with outputs...