PaulMcInnis / JobFunnel

Scrape job websites into a single spreadsheet with no duplicates.
MIT License
1.78k stars 210 forks source link

Remove brotli encoding #139

Closed marchbnr closed 3 years ago

marchbnr commented 3 years ago

Remove brotli compression from accepted encodings for indeed sessions

Description

Resolves an issue related with the indeed scraper where the responses are not decoded correctly. Brotli support can be added again if the brotli package is added to the dependencies.

Context of change

Please add options that are relevant and mark any boxes that apply.

Type of change

Please mark any boxes that apply.

How Has This Been Tested?

Only tested locally so far. Unit tests still run through.

Checklist:

Please mark any boxes that have been completed.

marchbnr commented 3 years ago

This might also be a macos specific issue. My specs: ProductName: macOS ProductVersion: 11.2 BuildVersion: 20D64

PaulMcInnis commented 3 years ago

Merging this since it seems to fix the massive issues with existing release.

Thanks for this contribution!