eXtensibleCatalog / OAI-Toolkit

Synchronize MARC metadata in most ILSs with XC
5 stars 1 forks source link

Do new full harvests of the OAI Toolkit ever return marked-deleted records? #33

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
This is a question to verify.  After an OAI Toolkit has been running for a
while and accumulates a set of marked-deleted records, let's say a new
harvester comes along and does a full harvest.  Will the OAI Toolkit
deliver the marked-deleted records, or just records that are not-deleted? 
Returning marked deleted records in this case is inefficient.  

Original issue reported on code.google.com by dlind...@library.rochester.edu on 13 Nov 2009 at 8:43

GoogleCodeExporter commented 9 years ago
Sorry for the delay in answering this. Just failed to notice it.

The answer to your question is the OAI Toolkit would deliver not-deleted 
records and 
not the deleted ones. 

OAI Toolkit commits the records at a last step of the load process. So, if the 
loading of the deleted records hasnt been completed, some other harvester would 
get 
the copy of the records which were harvested before the current loading in the 
OAI 
Toolkit.

Original comment by sva...@library.rochester.edu on 8 Jan 2010 at 8:25

GoogleCodeExporter commented 9 years ago
I think the answer was to a different question.  Shrey is saying that if 
deletes are
occurring in the current processing session but not committed, then they would 
not be
available for harvest.

I think Dave is asking if a feature exists to not serve up "marked deleted  
records"
if it is a first full harvest (e.g. a first full harvest by a brand new OAI 
requestor
would not need deleted records).  This feature does not exist.  I have 
confirmed with
Shrey.

Original comment by rc...@library.rochester.edu on 18 Feb 2010 at 4:30

GoogleCodeExporter commented 9 years ago

Original comment by cede...@uillinois.edu on 14 Dec 2010 at 9:57

GoogleCodeExporter commented 9 years ago
New harvests (which are detected by the absence of a "from" parameter) no 
longer get marked deleted records.  Rev. 108

Original comment by cede...@uillinois.edu on 15 Dec 2010 at 7:55

GoogleCodeExporter commented 9 years ago
Released in version 0.6.8alpha

Original comment by cede...@uillinois.edu on 4 Jan 2011 at 8:21