search

anyweez / matchgrab

Retrieve and store archive of matches and summoners.
MIT License
1 stars 0 forks source link

Request and decode gzip'd data #8

Closed anyweez closed 7 years ago

anyweez commented 7 years ago

Add Accept-Encoding: gzip and decode payload. I think its ok to assume that we'll always get gzip'd data back.

anyweez commented 7 years ago

Work happening here: https://github.com/anyweez/matchgrab/tree/request-gzip

anyweez commented 7 years ago

Implementation seems to be reducing response body size dramatically (gzipped body is ~11% the size of uncompressed body). I'm currently seeing an increase in bandwidth consumption while actually running matchgrab while individual measurements show this reduction. Need to figure out what's going on there.

https://docs.google.com/spreadsheets/d/1AU7X68LxU8SlpNAAwMRCx6zcF-hPl_AlSxVzTD3llqM/edit#gid=0

anyweez commented 7 years ago

Merged initial work but still not seeing benefits; tracking bug to fix this in #16.