search

mwmbl / crawler-extension

A browser extension that can be installed by volunteers to participate in mwmbl distributed crawling.
GNU Affero General Public License v3.0
21 stars 2 forks source link

Specify the desired language in our requests #31

Closed daoudclarke closed 1 year ago

daoudclarke commented 2 years ago

Add a request header to specify English as we're only crawling English content for now: https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Accept-Language

daoudclarke commented 1 year ago

Need to make the change here: https://github.com/mwmbl/crawler-extension/blob/master/src/background.js#L63