Closed aallyn closed 3 years ago
Ha, just breaking stuff left and right as usual :) These little bits were mostly trying to figure out if I could create something similar to what you/Alex/Dylan have created from scratch, leveraging the code you've written and our FaCeT computational team meetings. Along with learning what's going on, I'm hoping it means I will be able to more easily create something similar for the "simulation" work and know how to integrate it with the FaCeT workflow. The targets side of it came up after @adamkemberling discovered the package -- it seems to be a nice bridge towards thinking about this whole workflow stuff, while not necessarily needing to work outside of RStudio. That said, it also has some limitations. For example, given its ties to R, we wouldn't be able to include/visualize how processing stages that use Python code fit into the full workflow -- something that Pachyderm overcomes.
@aallyn looks like you've been busy! is this something you're going to implement for your FaCeT work as well? if so, we should think about eventually 1) integrating your pachy workflow(s) into the main FaCeT repo and 2) building some diagrams for both the overall workflow and specific pipelines