Write a script to extract text from Inuktitut Magazine

[GoogleCodeExporter]

Purpose of addition of this task:
We want to use the text in Inuktitut Magazine because its an aligned corpus for 
3 languages(English, French, Inuktitut and Inuktitut Romanized)
To use the text we need to run pdftotext on the pdfs. Unfortunatly the encoding 
of the Inuktitut is Nunacom, not Unicode. We should try to find a transcoder 
(http://www.inuktitutcomputing.ca/Transcoder/index.php?lang=en) or write one to 
turn the seeming garbage into unicode.

When reviewing task, please focus on:
creating a quick and dirty transcoder for the words that look like garbage (on 
the hypothesis that those are sylabics)

After the review, please add the script to Tools for field linguistics source 
code.

After the review, the expected next step is to:
To run the extract function and content words script on the corpus to get a 
feel for the corpus size and vocabulary.

Original issue reported on code.google.com by a...@ilanguage.ca on 9 Nov 2011 at 10:25

• Blocking: #14
• Blocked on: #10

[GoogleCodeExporter]

Original comment by a...@ilanguage.ca on 9 Nov 2011 at 10:35

[GoogleCodeExporter]

The script is in this commit

http://code.google.com/p/ilanguagelab/source/detail?r=ba1c76e0b92704034dc42cec08
222f59d16aba2b

Original comment by gina.c.c...@gmail.com on 9 Nov 2011 at 10:49

• Changed state: Fixed

[GoogleCodeExporter]

Original comment by a...@ilanguage.ca on 25 Nov 2011 at 10:25

• Added labels: Type-Implementation