FreeUKGen / BMD-X

OS X client for the BMD genealogy database
Apache License 2.0
1 stars 2 forks source link

Possible issue with single quotes as pertains to encoding #22

Closed stwf closed 10 years ago

stwf commented 10 years ago

Character not in FreeBMD character set (ISO8859-1): 'Single low-9 quotation mark' at line 39 (RIMMER,John R.,D’Arcy,Liverpool S.,8b,364)

This is repeated for similar lines and there is a similar message around district names. I all cases it is due to the use on an apostrophe ('). Editing in the upload screen clears the problem so it is not terminal just a nuisance.

resnape commented 10 years ago

Concur with your observation. It would however be interesting how the MS Windows version of the BMD software addresses this issue. I shall pose the question with my BMD Coordinator.

resnape commented 10 years ago

I have researched the FreeBMD site regarding this issue and I have found this quote

"Only characters that are part of the character set ISO8859-1 are valid. Using characters from the Windows Character Map won't work"

The earlier version of MacBMD correctly inserted the single Apostrophe without any issues with uploaded transcribed files. Currently with Version 1.04 any single apostrophe entered from the keyboard is ignored in the submitted file without any error message, as expected. Amending the submitted file to include the single apostrophe is accepted without error.

Interestedly, I import my transcribed file into Excel in a comma delimited form to proof read the transcribed file and the Single Apostrophe is incorrectly rendered as follows:

LEET David Hammond KingÕs L. 4b 1682

resnape commented 10 years ago

FYI . I have contaminated :-) my MAC with the Windows version of the BMD and tested the insertion of an apostrophe (') into a file which was then imported into excel to test the decoding. The apostrophe was correctly encoded so Windows must use and extension of ISO8859-1 or they use the Unicode version. more research is needed methinks.

stwf commented 10 years ago

ok, the 1.0.6 version will save files as MacRoman, which is the closest Apple encoding I could find to ISO8859-1. Hopefully this will work.

stwf commented 10 years ago

btw the 1.0.6 version is uploaded here at the root of the project. It would be helpful if you could try it out to see if this is better.

resnape commented 10 years ago

G’day Steve

I’m not currently transcribing any files that will test the fix for single quotes, but I will generate a test file and upload it to FreeBMD this weekend and let you know the outcome.

Regards Ralph E Snape

On 4 Apr 2014, at 03:47, stwf notifications@github.com wrote:

btw the 1.0.6 version is uploaded here at the root of the project. It would be helpful if you could try it out to see if this is better.

— Reply to this email directly or view it on GitHub.

resnape commented 10 years ago

G’day Steve

Ran a short test for the single quote issue. The results are as follows:

Still an issue I am afraid

Regards Ralph

On 4 Apr 2014, at 03:47, stwf notifications@github.com wrote:

btw the 1.0.6 version is uploaded here at the root of the project. It would be helpful if you could try it out to see if this is better.

— Reply to this email directly or view it on GitHub.