CUAHSI / HydroCatalog

3 stars 0 forks source link

Need to validate entire catalog #8

Open xhqiao89 opened 7 years ago

xhqiao89 commented 7 years ago

danames[CodePlex]
• check and validate the data in the catalog database. There seems to be various inconsistencies duplications, etc.

xhqiao89 commented 7 years ago

kimschreuders[CodePlex]
One other thought, you need to be careful when updating the metadata catalog that the associated tagging gets handled properly. The tagging needs to be carefully managed to make sure that it is updated appropriately so that the tagging is handled by one of these method, i.e. if series identifiers are changed: 1) tagging that can be saved (i.e. it is clear that tags for a particular old series should be transfered to a particular new series) should be pointed at the new identifiers, 2) tagging that cannot be saved should be either deleted or indicated as orphaned and messages should go out to the administrators of the data set letting them know that their series are not tagged and/or that they have orphaned tags that need to be cleaned up.

xhqiao89 commented 7 years ago

kimschreuders[CodePlex]
It looks like issues # 7, 16, 18, and 19 are all examples of bad data in the metadata catalog. A comprehensive review and/or a complete re-harvest of the entire catalog needs to be made.

xhqiao89 commented 7 years ago

valentinedwv[CodePlex]
Examples?