search

twintproject / twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
MIT License
15.7k stars 2.72k forks source link

[QUESTION] Adding cookies to requests no longer working? #1038

Open aybli opened 3 years ago

aybli commented 3 years ago

I'm trying to also get tweets with potentially sensitive content by using my account cookies. The solution to add the cookies to the headers like described in issues #543 and #560 doesn't seem to work anymore. The code changed and there are now three lines containing "RequestUrl": https://github.com/twintproject/twint/blob/a45a8ac719d5710e7da92f77d9801b351e505c1f/twint/run.py#L62 https://github.com/twintproject/twint/blob/a45a8ac719d5710e7da92f77d9801b351e505c1f/twint/run.py#L66 https://github.com/twintproject/twint/blob/a45a8ac719d5710e7da92f77d9801b351e505c1f/twint/run.py#L79-L80 I added my account cookies and edited the lines above like described in issue #560 so all three lines look like this: response = await get.RequestUrl(self.config, self.init, headers = [("User-Agent", self.user_agent), ("Cookies",cookies)])

Now when I run twint I get this error: TypeError: RequestUrl() got an unexpected keyword argument 'headers'

Is there another way to do this?

Mr-Weihuawei commented 3 years ago

Hi aybli I also encountered this problem, have you found a solution?

aybli commented 3 years ago

Hi aybli I also encountered this problem, have you found a solution?

Hi Mr-Weihuawei, I have tried to do fix it myself but I just ended up running into more problems. I'm hoping someone knowledgable about these new changes can provide some information.

himanshudabas commented 3 years ago

Hi,

I apologise for the issue you are currently facing. It's because when I ported the twint for newer twitter endpoints after older endpoints were depricated I had to change a lot of code. Thats the reason a lot of twint functionality is broken right now. Moreover the development of twint is way to slow right now, PR doesn't seem to get merged for a long time, so I am really reluctnat to put up new PRs. If I am not too busy in the upcoming month, I'll try to fix as many things as I can.