Yet Another Reddit Scrapper (without API keys) | Scrap search results, posts and images from subreddits filtered by hot, new etc and bulk download any user's data.
MIT License
21
stars
11
forks
source link
Implement ability to set user agent and randomize user agent #7
In this pull request, we implement the ability to set the user agent, as well as implementing the ability to set a random user agent from this list of user agents. I have used this user agent randomization in one of my own projects to scrape google translate responses, and seems to help my program avoid getting timeouts.
Full disclosure, I am submitting this pull request as a part of Hacktoberfest 2024.
In this pull request, we implement the ability to set the user agent, as well as implementing the ability to set a random user agent from this list of user agents. I have used this user agent randomization in one of my own projects to scrape google translate responses, and seems to help my program avoid getting timeouts.
Full disclosure, I am submitting this pull request as a part of Hacktoberfest 2024.