mikemccand / chromium-compact-language-detector

Automatically exported from code.google.com/p/chromium-compact-language-detector
160 stars 31 forks source link

chromium-compact-language-detector unable to detect Japanese #20

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?

1. Import CLD

2. Text = '1/15 HR Div.Q&CS Dept.全体MTG 開催
1月15日(水)、赤溜オーディトリアムにてHR Div.Q&CS 
Dept.の全体MTGが開催されました。
アジェンダは以下のとおりです。'

3. cld.detect(smart_str(text), pickSummaryLanguage=True, 
removeWeakMatches=False)

What is the expected output? What do you see instead?

The Japanese language is not detected, only it is detecting English language

What version of the product are you using? On what operating system?
ubuntu 10.04
CLD
python 2.7
Django 1.4.0

Please provide any additional information below.
CLD is unable to detect Japanese language.

Original issue reported on code.google.com by joshi.v...@gmail.com on 24 Jan 2014 at 9:36

Attachments:

GoogleCodeExporter commented 9 years ago
Hi, can you open an issue against CLD2?  https://code.google.com/p/cld2/

This project is just the Python bindings around CLD2, so the detection error is 
an issue there.

Original comment by luc...@mikemccandless.com on 24 Jan 2014 at 10:12

GoogleCodeExporter commented 9 years ago
Hi I am using CLD not CLD2(version 2). 

Do you want me to open CLD issue in CLD2 ?

Please suggest.

Original comment by joshi.v...@gmail.com on 27 Jan 2014 at 6:38

GoogleCodeExporter commented 9 years ago
Oh, you should probably upgrade to CLD2?  Have you tested CLD2 to see if the 
issue still happens there?

Original comment by luc...@mikemccandless.com on 27 Jan 2014 at 10:06

GoogleCodeExporter commented 9 years ago
Upgraded to CLD2. 

now everything works it is detecting japanese.

Thanks

Original comment by joshi.v...@gmail.com on 28 Jan 2014 at 8:04

GoogleCodeExporter commented 9 years ago
That's great news!

Original comment by luc...@mikemccandless.com on 28 Jan 2014 at 3:06