mattpodolak / pmaw

A multithread Pushshift.io API Wrapper for reddit.com comment and submission searches.
MIT License
213 stars 28 forks source link

Successful Rate 0% no matter what #36

Closed eryk-mazus closed 2 years ago

eryk-mazus commented 2 years ago

Hi,

I found a strange issue, similar to #23. Basically, now matter what I do I get 0% Successful Rate when trying to fetch comments by their ids. I tried to pass the ids as list and as a joint string with ids delimited by ,.

Below is the reproducible example with sample of ids that I want to fetch:

import time
from pmaw import PushshiftAPI

api = PushshiftAPI()

if __name__ == "__main__":
    # list of comments
    comment_ids = ['czyja5h', 'czyjfsw', 'czyjhfs', 'czyjhqz', 'czyjufm', 'czyk71o', 'czykgjk', 'czykuef', 'czyl1me', 'czylher']

    # fetch the body of comments
    t = time.time()

    comments = api.search_comments(ids=comment_ids)
    comment_list = [comment for comment in comments]

    print(f"Fetching {len(comment_list)} comments complete, it took {time.time() - t:.3f}s")
    print('...')
mattpodolak commented 2 years ago

thanks for reporting this issue! i'll take a look

Randcd415 commented 2 years ago

I'm experiencing this as well.

mattpodolak commented 2 years ago

It looks like theres currently an issue with the id search on Pushshift, the example comments id search query provided in the Pushshift API documentation returns an Internal Server Error

casonk commented 2 years ago

image

Been down for a few hours now