search

skybristol / geokb

Data processing workflows for initializing and building the Geoscience Knowledgebase
The Unlicense
3 stars 3 forks source link

Build process to check the profile inventory for new/missing profiles #10

Closed skybristol closed 10 months ago

skybristol commented 11 months ago

When we run the periodic process to check for new personnel profiles and dump these to the source item, we have to go check that for any new profiles we need to examine or anything that's disappeared. Disappearing profiles either means that someone left and the OCAP folks decided to get rid of their profile (they don't always) or we might have a redirect to deal with. The process here will need to pull the existing staff profile URLs from the GeoKB and compare to figure out what to do.

skybristol commented 10 months ago

I got an initial cut at this done after some pain trying to clean up and deal with vagaries introduced by how poorly the Staff Profiles system is managed. I think I have most of the persons with profiles as of today represented in the GeoKB. I've added all of their cached profile documents to Item_talk pages so that I can build the processor out for that next. I'll need to revisit this code to get it teed up to run periodically at a later time.