openaire / iis

Information Inference Service of the OpenAIRE system
Apache License 2.0
20 stars 11 forks source link

Fuzzy citation matching input and output transformers do not remove output dir at startup #1428

Closed marekhorst closed 1 year ago

marekhorst commented 1 year ago

This may result in input or output transformer spark job failure when reattempting citation matching workflow without prior output directory removal. This is usually the case when reruning citation matching job run in isolation (dev execution mode).