search

JustAnotherArchivist / snscrape

A social networking service scraper in Python
GNU General Public License v3.0
4.43k stars 706 forks source link

Twitter now requires login to view content #994

Closed Maniktherana closed 1 year ago

Maniktherana commented 1 year ago

Will this affect snscrape? I’m new to scraping so not sure if this affects scrapers.

elleobrien commented 1 year ago

(not maintainer, just a user) I expect it will. Some scraping processes use libraries like selenium to pass account credentials through a login interface, but not sure how to integrate this best with snscrape.

Maniktherana commented 1 year ago

Makes sense. Meanwhile my current workflow for scraping Twitter isn’t working anymore.

JustAnotherArchivist commented 1 year ago

Chances are it eventually will if they don't reverse course. But in any case, speculation isn't useful, and my crystal ball broke last week. For now, snscrape's Twitter scrapers still work. Use them while you can.

TheTechRobo commented 1 year ago

@elleobrien Auth won't be supported: #270

Maniktherana commented 1 year ago

I get that this topic’s closed but

https://twitter.com/elonmusk/status/1675187969420828672?s=46