nils-braun / b2luigi

Task scheduling and batch running for basf2 jobs made simple
GNU General Public License v3.0
17 stars 11 forks source link

Work with different non-file luigi targets #87

Open meliache opened 3 years ago

meliache commented 3 years ago

@bilokin reported that he created a custom database-target found that he had to create a dummy self.path attribute and a dummy makedirs() method to get it to work, otherwise exceptions were encountered.

I was surprised, I had expected that as long as you don't use any b2luigi-specific output methods like self.add_to_output() are used and b2luigi is basically only used for working on remote batch systems, all b2luigi targets should be supported. But I haven't looked at this properly yet, so I'm not sure if this should be considered a bug in b2luigi. Probably should create a minimal example for reproducing that error first.