AssertionError in gen_zip_code_seed.py

[GoogleCodeExporter]

What steps will reproduce the problem?
1. Checkout Mozc 2.16.2016.102 (r482) on Ubuntu 14.04
2. cd data/dictionary_oss
3. Download following postal code files from Japan Post website (as of 2015 Jan 
18th) and unzip them.
   - http://www.post.japanpost.jp/zipcode/dl/oogaki/zip/ken_all.zip
   - http://www.post.japanpost.jp/zipcode/dl/jigyosyo/zip/jigyosyo.zip
4. python ../../dictionary/gen_zip_code_seed.py --zip_code=KEN_ALL.CSV 
--jigyosyo=JIGYOSYO.CSV >> dictionary09.txt

What is the expected output?
gen_zip_code_seed.py finished without any error.

What do you see instead?
The command fails with following error:

Traceback (most recent call last):
  File "../../dictionary/gen_zip_code_seed.py", line 270, in <module>
    sys.exit(main())
  File "../../dictionary/gen_zip_code_seed.py", line 261, in main
    ProcessZipCodeCSV(options.zip_code)
  File "../../dictionary/gen_zip_code_seed.py", line 91, in ProcessZipCodeCSV
    for entry in ReadZipCodeEntries(tokens[2], tokens[6], tokens[7], tokens[8]):
  File "../../dictionary/gen_zip_code_seed.py", line 189, in ReadZipCodeEntries
    for town in ParseTownName(level3)]
  File "../../dictionary/gen_zip_code_seed.py", line 204, in ParseTownName
    % level3.encode('utf-8'))
AssertionError: failed to be merged 
大桑町（ア、イ、ヰ、ウ、上野、ヲ、オ乙、鐘搗山、上川��
�、上猫下、

Please use labels and text to provide additional information.
This issue was originally reported as Issue 205.

Original issue reported on code.google.com by yukawa@google.com on 17 Jan 2015 at 4:05

[GoogleCodeExporter]

This issue was closed by revision r483.

Original comment by yukawa@google.com on 17 Jan 2015 at 4:10

• Changed state: Fixed

[GoogleCodeExporter]

Issue 205 has been merged into this issue.

Original comment by yukawa@google.com on 17 Jan 2015 at 4:11