crash

[paolobenve]

Running

wapiti https://www.mysite.net/ -u -n 5 -b domain -v 2

after a while I got:

/usr/lib/python2.7/dist-packages/BeautifulSoup.py:1858: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
  elif data[:4] == '\x00\x00\xfe\xff':
/usr/lib/python2.7/dist-packages/BeautifulSoup.py:1861: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
  elif data[:4] == '\xff\xfe\x00\x00':
Traceback (most recent call last):
  File "/usr/bin/wapiti", line 469, in <module>
    wap.browse(crawlerFile)
  File "/usr/bin/wapiti", line 196, in browse
    self.myls.go(crawlerFile)
  File "/usr/lib/python2.7/dist-packages/wapitiCore/net/lswww.py", line 672, in go
    if self.browse(lien):
  File "/usr/lib/python2.7/dist-packages/wapitiCore/net/lswww.py", line 285, in browse
    page_encoding = BeautifulSoup.BeautifulSoup(resp.getRawPage()).originalEncoding
  File "/usr/lib/python2.7/dist-packages/BeautifulSoup.py", line 1522, in __init__
    BeautifulStoneSoup.__init__(self, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/BeautifulSoup.py", line 1147, in __init__
    self._feed(isHTML=isHTML)
  File "/usr/lib/python2.7/dist-packages/BeautifulSoup.py", line 1189, in _feed
    SGMLParser.feed(self, markup)
  File "/usr/lib/python2.7/sgmllib.py", line 103, in feed
    self.rawdata = self.rawdata + data
TypeError: cannot concatenate 'str' and 'NoneType' objects

[swebsas]

Similar problem. Anyone with solution? Traceback (most recent call last): File "/usr/bin/wapiti", line 469, in wap.browse(crawlerFile) File "/usr/bin/wapiti", line 196, in browse self.myls.go(crawlerFile) File "/usr/lib/python2.7/dist-packages/wapitiCore/net/lswww.py", line 672, in go if self.browse(lien): File "/usr/lib/python2.7/dist-packages/wapitiCore/net/lswww.py", line 421, in browse kv[1] = kv[1].encode(page_encoding, "ignore") TypeError: encode() argument 1 must be string, not None