Open landoskape opened 2 months ago
Hi Andrew, thank you for your kind words. Your idea does sound interesting (and even useful), but perhaps not a perfect fit for pydeps..? I've known to occasionally be wrong, though, and I'm always happy to merge PRs (I'm also happy to help if you get stuck...)
Let me look around and have a go at it. I'll ping if I need some help. Thanks!
Pydeps is an excellent tool for visualizing dependencies. I wonder if it could be adapted to show the dynamic dependencies of a particular pipeline. For example, imagine a simple pipeline built with numpy and matplotlib that goes from raw data to visualization.
Here's an example:
We've defined a pipeline which uses these methods in the following order:
np.load
numpy_processing.process0
numpy_processing.process1
numpy_processing.process2
prepare_vis
vis
Wouldn't it be cool to see a pydeps graph where these methods are provided as input, are positioned on the left column of a graph moving downwards, and the dependencies are shown to the right pointing to each part of the pipeline?
If this is possible, please let me know. If there's interest and I could be of assistance in writing code to support it, let me know.