Updating (reparsing) database should remove old entries. - Githubissues

JonathanReeve / sanger

Margaret Sanger Papers Project Search Engine

0 stars 3 forks source link

Updating (reparsing) database should remove old entries. #30

Closed JonathanReeve closed 11 years ago

JonathanReeve commented 11 years ago

Add this logic:

When parsing a document:

check to see whether the document (by filename) is already in the database table "documents"
if it is, remove that record
also remove records in mentioned_ tables with same filenames

JonathanReeve commented 11 years ago

The logic was pretty much already there. It turns out this was not the problem, but that journals don't get removed before reparsing. Unfortunately, since journals can be associated with more than one document, this becomes tricky. Now, what is needed upon reparsing is:

Find associated journal of already-existing document to be reparsed
See if that journal is associated with any other documents
If it is, do nothing
If it isn't, remove the journal in case the new document has a correction in the journal name.

Opening new bug report for this: #53.