PushShift not downloading if over_18 = true

[YDdraigGoch]

Describe the bug

Hello. Thanks for this project. Whenever I set a PushShift source for a user and set the criteria to be over_18 equals (or matches) true, it just doesn't download anything or skips the user.

I would like to add that the over_18 criteria works with the normal Reddit search.

Environment Info

• OS: Docker for Debian
• RMD Version: 3.1.0 (I pulled 3.1.1 but it just won't recreate I'll work it out)

[shadowmoose]

Hey, thanks for the report. I am unable to replicate this locally. Do you mind sharing some of your exact configuration details for that Source, so that I can try to replicate it that way?

[YDdraigGoch]

This is the json in the config file, I've cut it down to show one PushShift source, and then replaced the user with [], same with my auth keys :P. I've also taken a screenshot of the source item: https://i.imgur.com/N36mE7M.jpg . I don't think GitHub will prettify the JSON so sorry in advance

{ "auth": { "oauth_key": "[MY-OAUTH-KEY]", "refresh_token": "[REFRESH TOKEN]", "rmd_client_key": "[CLIENT KEY]", "user_agent": "RMD-Scanner-b52d52fb-c3ae-4bb2-a7d4-11ab20377ead" }, "imgur": { "client_id": "[CLIENT ID]", "client_secret": "[CLIENT SECRET]" }, "interface": { "browser": "off", "host": "0.0.0.0", "keep_open": true, "port": 7505, "start_server": true }, "misc": { "meta-version": 6, "sources": [ { "alias": "[User from a NSFW subreddit]- PushShift", "data": { "limit": 0, "scan_comments": true, "scan_submissions": true, "users": "[User from a NSFW subreddit]" }, "filters": { "over_18.equals": "true" }, "type": "pushshift-user-source" } ] }, "output": { "base_dir": "/download", "file_name_pattern": "[author]/[type]/[author]-[created_date]-[created_time]-[title]", "manifest": "./manifest.sqlite" }, "processing": { "deduplicate_files": true, "retry_failed": true }, "threading": { "concurrent_downloads": 3, "console_clear_screen": true, "display_refresh_rate": 5 } }