FreeUKGen / FreeCENMigration

Issue tracking for project migrating FreeCEN to FreeCEN2 genealogy record database and search engine architecture. Code developed here is based on that developed in MyopicVicar
https://www.freecen.org.uk
Apache License 2.0
4 stars 3 forks source link

Manage Parms and their Pieces Directly on CEN2 #852

Open Captainkirkdawson opened 4 years ago

Captainkirkdawson commented 4 years ago

Currently Parms and their pieces are entered into CEN2 by the monthly update that transfers the CEN1 input files to CEN2. There is a requirement to a) load Parms and Pieces directly into CEN2 by uploading a parms file directly into CEN2; b) Perform online edits to Pieces; c) protect these uploads and changes from the monthly transfer update.

Captainkirkdawson commented 4 years ago

The new set of parms extracted from TNA by @richardofsussex have been loaded into test3. The process for accessing these parms is described here https://drive.google.com/file/d/1kUz0pOhnoQaNjVDBuJUT2gORGFRC57FD/view?usp=sharing. There are a few warts in the data but in most cases it is of high quality. Parms are there for all counties in England and Wales for all years 1841-1911. The next step is for @geoffj-FUG @FreecenBren to conduct an initial review and assessment.

geoffj-FUG commented 4 years ago

Kirk Looks good. I have a question. I presume we are looking at a .csv version of the PARMS. How is the actual file formatted. Is it a table / array? I ask because we are going to test the Civil Parish in the transcriptions against the PARMS. As it is presented at the moment we would be searching on a sub-string. When I downloaded the files that were previously available from Richard and transferred them to a spreadsheet they came up as a table. I assume that that is the format of the actual table. The format available in the view is suitable for the Coordinators. That is what they are used to. The link with the TNA is very good. It allows the Coordinator to check the TNA record when there is a mis-match. I presume that the code to test the Civil Parish against the PARMS is now on the To Do list for future testing? We need a procedure for reporting any errors to the TNA. I will put it on my To Do list and pick that up later.

Captainkirkdawson commented 4 years ago

@geoffj-FUG The files from Richard are not csv but xml They are ingested into CEN2 are linked database collections are created for each Districts, Subdistricts, and Civil Parishes with the District keyed to the Chapman Code. Is there the need for any download????? and if so what. Don't tell me ctyParms. What is the actual requirement? CSVProc use of these tables remains to be done.

geoffj-FUG commented 4 years ago

Kirk There is no need for a download as far as I can see. However there needs to be a process to edit corrections. For integrities sake I see this as being centralised so that when a correction is done we do advise National Archives of the need. Geoff

Captainkirkdawson commented 4 years ago

Thank you @geoffj-FUG I agree on the need for an edit capability. I also agree on the need for centralized control and this should likely be the Data Managers

Captainkirkdawson commented 4 years ago

Edit capability to be added