For some fields we can define sensible defaults. Some of them should be required.
I suggest that this would be handled in the transformation phase, as this should not be blocking the scraping. Therefore, we also need some sort of log or output in the transformation phase, in case a required field does not have a value.
For some fields we can define sensible defaults. Some of them should be required. I suggest that this would be handled in the transformation phase, as this should not be blocking the scraping. Therefore, we also need some sort of log or output in the transformation phase, in case a required field does not have a value.