taspinar / twitterscraper

Scrape Twitter for Tweets
MIT License
2.39k stars 581 forks source link

Getting Error 400 from twitter when sending the "X-Requested-With": "XMLHttpRequest" header #348

Closed meirtolpin11 closed 3 years ago

meirtolpin11 commented 3 years ago

Hi! So I tried to use the tool, but it's not working. I am getting Error 400 from twitter when sending this header - "X-Requested-With": "XMLHttpRequest"

`

  def __init__(self, username):
        headers = {
            "Accept": "application/json, text/javascript, */*; q=0.01",
            "Referer": f"https://twitter.com/{username}",
            "User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/603.3.8 (KHTML, like Gecko) Version/10.1.2 Safari/603.3.8",
            "X-Twitter-Active-User": "yes",
            "X-Requested-With": "XMLHttpRequest",
            "Accept-Language": "en-US",
        }

        page = session.get(f"https://twitter.com/{username}", headers=headers)
        self.username = username
        self.__parse_profile(page)`

ideas how to fix ?