search

pushshift / api

Pushshift API
1.29k stars 109 forks source link

Score not showing in sorted order #33

Open iknoorjobs opened 5 years ago

iknoorjobs commented 5 years ago

For this endpoint, score does not show up (shows 1 only). Also results are not sorted even after passing sort parameter as score. http://api.pushshift.io/reddit/comment/search/?link_id=91ps39&size=50&sort_type=score&sort=desc

But if I explicitly mention score parameter then the results are correct. http://api.pushshift.io/reddit/comment/search/?link_id=91ps39&size=50&sort_type=score&sort=desc&score=>-100

Why this? Please check

pushshift commented 5 years ago

This is an artifact of using both Postgres and ES to return results based on what parameters are passed. At the time, Postgres was faster for certain queries but improvements to ES now allow for a Lucene index to be created which makes using Postgres in combination with ES less desirable.

This will get fixed in the future API release once Postgres is removed entirely from the API. In the meantime, I would suggest using the second method to get the updated score.

duarteocarmo commented 4 years ago

Having the same issue here. Had to sort by num_comments.

Let me know if there is something I can do to help!

imbarismustafa commented 4 years ago

Hopefully, this gets fixed soon as the issues still persist and only can be sorted by num_comments. Thanks.