Earlier it was possible to scrape only with an unauthenticated way and use a proxy in case of hitting the sign-up modals. This new feature will be able to provide a way to scrape data in an authenticated way. As mentioned in #29
User needs to login into the Twitter account once and get the browser profile's path. Pass it to the crawler with the argument browser_profile=YOUR_BROWSER_PROFILE_PATH the crawler will use that path of the browser for scraping. The whole function example would look like scrap_keyword(keyword="#GTA", browser="firefox", tweets_count=10, until="2022-06-30", since="2022-06-29", filename="GTA", browser_profile=r'C:\Users\<username>\AppData\Local\Google\Chrome\User Data\Default')
This feature is applicable same for all the 3 methods, that is scrap_keyword, scrap_topic, and scrap_profile
browser_profile=YOUR_BROWSER_PROFILE_PATHthe crawler will use that path of the browser for scraping. The whole function example would look likescrap_keyword(keyword="#GTA", browser="firefox", tweets_count=10, until="2022-06-30", since="2022-06-29", filename="GTA", browser_profile=r'C:\Users\<username>\AppData\Local\Google\Chrome\User Data\Default')scrap_keyword,scrap_topic, andscrap_profile