search

n0madic / twitter-scraper

Scrape the Twitter frontend API without authentication with Golang.
MIT License
886 stars 180 forks source link

Q: Scraping user profiles #130

Open 4yR1l1k opened 1 year ago

4yR1l1k commented 1 year ago

I have realized that we are able to scrape tweets through user profiles, however only the verified users return results. Also there are some weird occasions where the script is able to gather tweets from unverified users (but this doesn't apply always).

Has anyone noticed this? And is there a way to gather tweets from anybody no matter what they are verified or not?

Thank you.

Cheers

igronus commented 1 year ago

Just tried unverified profile and've got the tweets without any problems. Can you provide some examples?

kws1207 commented 10 months ago

I've also found out that scraper.FetchTweetsByUserID returns empty array for some profiles(ex. C4dotgg). I have no idea what makes the difference, but it seems not about whether the account is verified or not.