FreeUKGen / FreeUKRegProductIssues

Repo for user-reported FreeUKReg product issues
2 stars 0 forks source link

238690363 Data Problem (David Hickmott) #1485

Open ghost opened 2 years ago

ghost commented 2 years ago

Issue reported by David Hickmott at 2022-07-25 14:52:43 UTC Time: 2022-07-25T14:49:45+00:00 Session ID: Problem Page URL: https://www.freereg.org.uk/search_records/592ab8d7f493fd53f11286b1/thomas-oulder-baptism-sussex-billingshurst-1731-01-10?locale=en Previous Page URL: https://www.freereg.org.uk/contacts/592ab8d7f493fd53f11286b1/report_error?locale=en&query=62dead1586557420d527ad93 Reported Issue: The event date in the index shows 1630/1

SteveBiggs commented 2 years ago

This is a very strange one. Do a search for Thomas Oulder, baptism in Sussex between 1600 and 1800 and these are the results: image The last result shows a date of 10 Jan 1630/31 however when you select the record it shows the correct year as 1730/31 as in the transcription: image A search between 1700 and 1800 does not return the record.

edickens commented 2 years ago

I can't find the entry. Which UserID and Batch?

SteveBiggs commented 2 years ago

Click on the Problem Page URL: image

edickens commented 2 years ago

Looking at the Attic there are no copies of this file... Capture1.JPG In fact there are none for the other BA batches she uiploaded. I therefore assume that they were upoaded once only. But, they could have been edited online to correct any errors. We have no record of an entry before it was corrected online. Does that help?

Captainkirkdawson commented 2 years ago

cluster1:PRIMARY> db.freereg1_csv_entries.find({_id: ObjectId("592ab8d7f493fd53f11286b0")}) { "_id" : ObjectId("592ab8d7f493fd53f11286b0"), "error_flag" : "false", "county" : "Sussex", "place" : "Billingshurst", "church_name" : "St Mary", "register_type" : " Parish Register", "record_type" : "ba", "location" : "SSXBillingshurstStMaryPRba", "line_id" : "CER.SSXBILBA2.CSV.727", "file_line_number" : 727, "register_entry_number" : "", "birth_date" : "", "baptism_date" : "10 Jan 1730/31", "year" : "1730", "person_forename" : "Thomas", "person_sex" : "M", "father_forename" : "Jeremiah", "mother_forename" : "Ann", "father_surname" : "OULDER", "mother_surname" : "", "person_abode" : "", "father_occupation" : "", "notes" : "", "film" : "21-1-1-3", "film_number" : "00103", "freereg1_csv_file_id" : ObjectId("592ab6fbf493fd53f112789b"), "record_digest" : "OpZgpODlZnceb2NjvYw4bg==", "u_at" : ISODate("2018-03-27T19:44:12.714Z"), "c_at" : ISODate("2017-05-28T11:47:35.471Z"), "transcribed_by" : "Charlotte Ryan", "credit" : "CER" } cluster1:PRIMARY> db.search_records.find({freereg1_csv_entry_id: ObjectId("592ab8d7f493fd53f11286b0")}) { "_id" : ObjectId("592ab8d7f493fd53f11286b1"), "transcript_dates" : [ "10 Jan 1630/31" ], "search_dates" : [ "1731-01-10", "" ], "location_names" : [ "Billingshurst (St Mary)", " [Parish Register]" ], "search_soundex" : [ { "first_name" : "T520", "last_name" : "O436", "type" : "p" }, { "first_name" : "J650", "last_name" : "O436", "type" : "f" }, { "first_name" : "A500", "last_name" : "O436", "type" : "f" } ], "record_type" : "ba", "search_record_version" : "2017-05-07T14:04:40+00:00", "chapman_code" : "SSX", "line_id" : "CER.SSXBILBA2.CSV.727", "transcript_names" : [ { "role" : "ba", "type" : "primary", "first_name" : "Thomas", "last_name" : "OULDER" }, { "role" : "f", "type" : "other", "first_name" : "Jeremiah", "last_name" : "OULDER" }, { "role" : "m", "type" : "other", "first_name" : "Ann", "last_name" : "OULDER" } ], "freereg1_csv_entry_id" : ObjectId("592ab8d7f493fd53f11286b0"), "search_date" : "1631-01-10", "place_id" : ObjectId("53cbf613eca9eb03a6009ce3"), "digest" : "Z2NY27lIVv+sYP7bdlzAYA==", "u_at" : ISODate("2017-05-29T08:15:04.157Z"), "c_at" : ISODate("2017-05-28T11:47:35.817Z"), "search_names" : [ { "_id" : ObjectId("592ab8d7f493fd53f11286b2"), "first_name" : "thomas", "last_name" : "oulder", "origin" : "transcript", "type" : "p", "role" : "ba", "gender" : "m" }, { "_id" : ObjectId("592ab8d7f493fd53f11286b3"), "first_name" : "jeremiah", "last_name" : "oulder", "origin" : "transcript", "type" : "f", "role" : "f", "gender" : "m" }, { "_id" : ObjectId("592ab8d7f493fd53f11286b4"), "first_name" : "ann", "last_name" : "oulder", "origin" : "transcript", "type" : "f", "role" : "m", "gender" : "f" } ] }

edickens commented 2 years ago

Hi Kirk, I don't know where that came from, but I do see "transcript_dates" : [ "10 Jan 1630/31" ], "search_dates" : [ "1731-01-10", "" ] which looks wrong. I suspect that the year was corrected, but the "search_dates" did not get updated. I also notice a lot of last_name not in capitals. But perhaps that doesn't matter. Eric

DeniseColbert commented 2 years ago

If Eric is correct in his idea that it's the differences in the fields below:

Perhaps a rake task to identify incompatibilities between the two fields (record {birth}, {marriage} {burial} year and search year) year only- not worried about month.

Correct the search year field to contain the info in the record year field.

To prevent future errors, a check on search date field to make sure it has also been updated and prompt if not.