search

ivault / guess-language

Rescued from Google code archive
http://code.google.com/p/guess-language
GNU Lesser General Public License v2.1
0 stars 0 forks source link

guess_language sort of kills multiprocess #6

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1. create 20 processes using multiprocess
2. in each of them: from guess_language import guessLanguage
3. make them run at the same time doing hard work;

What is the expected output? What do you see instead?

processes died around me like flies

What version of the product are you using? On what operating system?
windows vista 64bit, python 266

Please provide any additional information below.

Workaround
i made the problem disappear by doing:

from guess_language import * 

instead

Original issue reported on code.google.com by gards...@bissedata.dk on 16 Oct 2010 at 1:14

GoogleCodeExporter commented 9 years ago 
            html = lxml.html.fromstring(raw)
            #html.make_links_absolute(url.urlpath(), resolve_base_href=True)
            txt = unicode(html.text_content())
            lang = guessLanguage(txt)
            url.tagged.append(lang,0001))
            self.tagtypetag(url,html)

Original comment by gards...@bissedata.dk on 16 Oct 2010 at 1:16