jiraken / crawler4j

Automatically exported from code.google.com/p/crawler4j
0 stars 0 forks source link

Remove the Language Identifier #308

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
Language Identifier is very nice to have but I think it takes a lot of time to 
identify the language.

Check if the time taken is only on first load and from then and on it is used 
as a singleton (then we can leave it).

If the LanguageIdentifier takes a long time for each uRL then we will have to 
get rid of it or just make it optional defaulted to false

Original issue reported on code.google.com by avrah...@gmail.com on 18 Sep 2014 at 4:00

GoogleCodeExporter commented 8 years ago
Checked and verified that it doesn't take a long time.

I am leaving it as is, just added a small comment

Original comment by avrah...@gmail.com on 23 Nov 2014 at 8:45