search

doniform / koosli.org

MIT License
0 stars 0 forks source link

Norwegian characters and 500 with Yahoo #36

Closed doniform closed 9 years ago

doniform commented 9 years ago

searching "trønder-avisa" or "åre" will 500 yahoo serach

thusoy commented 9 years ago

This is the stacktrace: ''' 2014-11-12 13:17:56,643 ERROR koosli Error occured! Path: /search Params: CombinedMultiDict([ImmutableMultiDict([('q', u'\xe5re')]), ImmutableMultiDict([])]) HTTP Method: GET Client IP Address: 62.73.195.218 User Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/38.0.2125.111 Chrome/38.0.2125.111 Safari/537.36 User Platform: linux User Browser: chrome User Browser Version: 38.0.2125.111 HTTP Headers: Referer: https://beta.koosli.org/search?q=what%3F Content-Length: User-Agent: Mozilla/5.0 (X11; Linux x8664) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/38.0.2125.111 Chrome/38.0.2125.111 Safari/537.36 Connection: keep-alive Cookie: session=[REDACTED] Dnt: 1 Host: beta.koosli.org Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/_;q=0.8 Accept-Language: en-US,en;q=0.8 Content-Type: Accept-Encoding: gzip,deflate

    Exception:            u'\xe5'

Traceback (most recent call last): File "/srv/koosli.org/venv/local/lib/python2.7/site-packages/flask/app.py", line 1817, in wsgi_app response = self.full_dispatch_request() File "/srv/koosli.org/venv/local/lib/python2.7/site-packages/flask/app.py", line 1477, in full_dispatch_request rv = self.handle_user_exception(e) File "/srv/koosli.org/venv/local/lib/python2.7/site-packages/flask/app.py", line 1381, in handle_user_exception reraise(exc_type, exc_value, tb) File "/srv/koosli.org/venv/local/lib/python2.7/site-packages/flask/app.py", line 1475, in full_dispatch_request rv = self.dispatch_request() File "/srv/koosli.org/venv/local/lib/python2.7/site-packages/flask/app.py", line 1461, in dispatch_request return self.view_functionsrule.endpoint File "/srv/koosli.org/venv/local/lib/python2.7/site-packages/koosli/views/search.py", line 68, in do_search api_response = perform_query_or_die_trying(query) File "/srv/koosli.org/venv/local/lib/python2.7/site-packages/koosli/views/search.py", line 49, in perform_query_or_die_trying return provider.search(query) File "/srv/koosli.org/venv/local/lib/python2.7/site-packages/koosli/search_providers/yahoo/init.py", line 57, in search 'q': quote_plus(query), File "/usr/lib/python2.7/urllib.py", line 1295, in quote_plus return quote(s, safe) File "/usr/lib/python2.7/urllib.py", line 1288, in quote return ''.join(map(quoter, s)) KeyError: u'\xe5' '''

fumbleforce commented 9 years ago 
# -*- coding: utf-8 -*-

in search_providers/yahoo/init.py?

doniform commented 9 years ago

Does this only indicate what encoding to expect? http://stackoverflow.com/a/7316975

thusoy commented 9 years ago

coding: utf-8 is only about the encoding of that document, that doesn't influence the stuff we get from the client. Have you managed to get the error in dev, Jørgen? I wont have time to look into this before in a couple of hours.