Add gzip + cache dir for caching

mattpodolak / pmaw

A multithread Pushshift.io API Wrapper for reddit.com comment and submission searches.

MIT License

212 stars 28 forks source link

Closed turtlesoupy closed 3 years ago

turtlesoupy commented 3 years ago

I'm doing a big scrape and was running out of disk space on my main drive so I added some gzip support + alternative caching location.

mattpodolak commented 3 years ago

Looks good to me. Thanks for the contribution!