This is with regards to the code in source_config.py. Is self.metadata expected to be the path to metadata.yaml? If so this piece of code will not do anything and hence returns
WARNING:Could not load dataset description from metadata file
and proceeds doing its thing.
By doing this it is actually not doing anything with the metadata path. Would it make sense to code it like this (?):
try:
with open(self.metadata, "r") as meta:
object.__setattr__(
self, 'metadata', DatasetDescription(**yaml.safe_load(meta))
)
except Exception as e:
raise ValueError(f"Unable to load metadata from {self.metadata}: {e}")
# LOG.warning(f"Could not load dataset description from metadata file")
This is with regards to the code in
source_config.py
. Isself.metadata
expected to be the path tometadata.yaml
? If so this piece of code will not do anything and hence returnsand proceeds doing its thing.
By doing this it is actually not doing anything with the
metadata
path. Would it make sense to code it like this (?):