Error: The file ".../eng_affix.dat" is not in the proper format. Expected the file to be in "iso-8859-1" not "utf8".

[ehsan]

I got this when updating Mozilla to the latest SCOWL. This is me following the usual instructions after making this change.

Full log:

$ ./make-new-dict
+ export LANG=C
+ LANG=C
+ export LC_ALL=C
+ LC_ALL=C
+ export LC_CTYPE=C
+ LC_CTYPE=C
+ export LC_COLLATE=C
+ LC_COLLATE=C
++ pwd
+ WKDIR=/Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources
+ export SCOWL=/Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl/
+ SCOWL=/Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl/
+ ORIG=/Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/orig/
+ SPELLER=/Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller
+ cd /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller
+ MK_LIST='../mk-list -v1 --accents=both en_US 60'
+ cat
+ ../mk-list -v1 --accents=both en_US 60
+ ./make-hunspell-dict -one en_US-custom params.txt
+ cd /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources
+ expand /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/en.aff
+ grep -v '^[0-9]\+$'
+ /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/munch-list expand /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/en.aff
+ sort -u
+ iconv -f utf-8 -t iso-8859-1 /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/orig//en_US-custom.dic
+ expand /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/orig//en_US-custom.aff
+ grep -v '^[0-9]\+$'
+ /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/munch-list expand /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/orig//en_US-custom.aff
+ sort -u
Error: The file "/var/folders/ry/m4kkhrl17c76cqyfd5qv5sph0000gn/T/lbEUzRNwN2//eng_affix.dat" is not in the proper format. Expected the file to be in "iso-8859-1" not "utf8".
+ expand ../en-US.aff
+ grep -v '^[0-9]\+$'
+ /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/munch-list expand ../en-US.aff
+ sort -u
+ iconv -f utf-8 -t iso-8859-1 /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/en_US-custom.dic
+ expand /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/en_US-custom.aff
+ grep -v '^[0-9]\+$'
+ /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/munch-list expand /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/en_US-custom.aff
+ sort -u
+ comm -23 1-base.txt 2-mozilla.txt
+ comm -13 1-base.txt 2-mozilla.txt
+ comm -23 3-upstream.txt 2-mozilla-rem
+ cat - 2-mozilla-add
+ sort -u
+ cat 4-patched.txt
+ comm -23 - 0-special
+ /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/make-hunspell-dict -one en_US-mozilla /dev/null
prep
creating en_US-mozilla.dic
  adding: README_en_US-mozilla.txt (deflated 58%)
  adding: en_US-mozilla.dic (deflated 66%)
  adding: en_US-mozilla.aff (deflated 68%)
+ expand ../en-US.aff
+ grep -v '^[0-9]\+$'
+ /Users/ehsan/moz/src.landing/extensions/spellcheck/locales/en-US/hunspell/dictionary-sources/scowl//speller/munch-list expand ../en-US.aff
+ sort -u
+ comm -12 3-upstream.txt 2-mozilla-rem
+ comm -13 3-upstream.txt 2-mozilla-add

If I had to guess, I would expect that this is somehow related to b20e89147c5cab20200d636c059a0512634b784d.

[kevina]

This turned out to be a problem with the downstream scripts I wrote for you. Closing this so be can handle the issue on Bugzilla (https://bugzilla.mozilla.org/show_bug.cgi?id=1240916).