JustAnotherArchivist / snscrape

A social networking service scraper in Python
GNU General Public License v3.0
4.52k stars 712 forks source link

How do I locally download images from Twitter instead of just linking the url? #909

Closed nnillat closed 1 year ago

nnillat commented 1 year ago

In the exported Twitter JSONL file, how can I download the media/profile picture strings and add another object with the path to the locally downloaded image? For archiving tweets, it's not very useful to not have the media saved as well.

I tried to write my own script to parse the file and download all the urls, but I keep getting an encoding error. What am I doing wrong? Is this feature built in?

JustAnotherArchivist commented 1 year ago

241