Bug: imdb engine

[fleurc]

Version of SearXNG, commit number if you are using on master branch and stipulate if you forked SearXNG Repository: https://github.com/paulgoio/searxng Branch: main Version: 1.0.0

Technical report

Error

• Error: KeyError
• Percentage: 65
• Parameters: ()
• File name: searx/engines/imdb.py:60
• Function: response
• Code: for entry in suggestions['d']:

Error

• Error: httpx.HTTPStatusError
• Percentage: 15
• Parameters: ('400', 'Bad Request', 'v2.sg.media-imdb.com')
• File name: searx/search/processors/online.py:97
• Function: _send_http_request
• Code: response = req(params['url'], **request_args)

[mrpaulblack]

Hi @fleurc , Thank you for your second bug report! Is IMDB getting blocked a lot for you? Looking at the error rate its only 15%... And checking: https://paulgo.io/search?q=%21imdb%20time&language=en-US&time_range=None&safesearch=1&categories=none works correctly for me. If this only happens sometimes I would like to close the issue, since the API still works correctly and getting sometimes blocked is normal.

[EDIT] wait I just saw that the error rate is actually pretty high: (I am going to check this a bit further first)

Also if you can get IMDB to break consistently could you share the query you are using?

Just to have it here:

[fleurc]

Sure, it was happening pretty often, but not exactly bothering me too much, i'll try to find a specific query to see if it breaks consistently

Here's a Query that gives the error consistently: Arcane Netflix

[fleurc]

That seems to be a pretty consistent behavior on some queries. If i search Spiderman Homecoming for an example it doesn't give any parsing error.

[dalf]

See https://github.com/searxng/searxng/pull/588 : the error appears when there is no result.

[mrpaulblack]

Woow that was fast. Thank you @dalf

[mrpaulblack]

Fixed in 5459ba20bd0155237812343bd071470d8e8359ff and https://github.com/searxng/searxng/commit/24c7d6300e4765be046b4e2bb1fde6d280ba049e upstream; Closing.