fix: result is reported but cannot be returned by Pushshift - Githubissues

mattpodolak / pmaw

A multithread Pushshift.io API Wrapper for reddit.com comment and submission searches.

MIT License

212 stars 28 forks source link

fix: result is reported but cannot be returned by Pushshift #39

Closed mattpodolak closed 2 years ago

mattpodolak commented 2 years ago

Bug

sometimes Pushshift reports additional remaining results for a query that it is unable to return, this causes pmaw to continue retrying queries infinitely

Fix

check that the length of results returned is > 0 before generating additional payloads. We can conclude that if Pushshift returns 0 while reporting that there are results remaining that the results remaining are unavailable

Linked Issues(s)

38