Could not decode message - error unpackb() got an unexpected keyword argument 'encoding'

scrapinghub / frontera

A scalable frontier for web crawlers

BSD 3-Clause "New" or "Revised" License

1.29k stars 215 forks source link

Open incognitozen opened 4 years ago

incognitozen commented 4 years ago

So I am working with the general spider in the example dir.

I am using the disributed mode as described in the docs here.

Everything seems to start and work ok.

Screenshot from 2020-05-01 17-33-27

However the spider on encountering the URL triggers the following error.

error unpackb() got an unexpected keyword argument 'encoding'

As you can see there is some encoding/decoding issue ?

I have tried to

Working with Ubuntu 18

jczerniakiev commented 4 years ago

@incognitozen Have you tried installing older version of msgpack (e.g. 0.6.2)?