search

AAndyProgram / SCrawler

🏳️‍🌈 Media downloader from any sites, including Twitter, Reddit, Instagram, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamster, XVIDEOS, ThisVid etc.
https://discord.gg/uFNUXvFFmg
GNU General Public License v3.0
1.23k stars 81 forks source link

Twitter parsing all tweets but not downloading. #85

Closed Rootkit- closed 1 year ago

Rootkit- commented 1 year ago

Creates post posts.txt and xml file with valid links to download I run download. I'm 99% sure I setup cookies bearer correctly IE setup for other sites before and infact I had done it once before on twitter a few months ago.

User: remarkablepaper (site: Twitter) Labels: No Parsed Path: K:!jd\Twitter\remarkablepaper\ Total downloaded (0): Pictures: 0 Videos: 0 Last updated at: not yet! Pictures: 0 Videos: 0 image image image image image image

AAndyProgram commented 1 year ago

I run download. I'm 99% sure I setup cookies bearer correctly IE setup for other sites before and infact I had done it once before on twitter a few months ago.

I'm sorry, but I'm not sure I understand you. You've been using SCrawler for a while and today is the first day you can't download Twitter posts. Am I correct? Did Twitter download everything correctly before?

As I can see from your screenshots, you have everything configured correctly. And LOG contains nothing.

I setup cookies bearer correctly IE setup

What does it mean? Have you grabbed cookies from IE? I really doubt IE has the same cookies table as Chrome, Edge or Firefox. You should use one of these browsers, not IE.

I use SCrawler almost every day. Today I successfully downloaded 4 Twitter profiles. It is possible that some of your credentials have expired. Please update your credentials and try again. Also make sure the user you are trying to download has checked the Download Images and Download videos options. If the problem persists after this, please post the URL of the profile you are trying to download. If the problem goes away, please leave a comment anyway.

User settings

AAndyProgram commented 1 year ago

BTW, as I can see, you checked Get user media only in your Twitter settings. It means that only posts posted by the user will be downloaded. Retweets of other profiles will be ignored. This explains why your file contains post IDs. Verify this option in the user settings and make sure that the user posted something himself (https://twitter.com/UserName/media). If the user hasn't posted anything and you want to download their retweets, you need to uncheck this option.

To redownload this profile, you must remove it from SCrawler and add it again. Then download it.

AAndyProgram commented 1 year ago

If you tried to download this profile (https://twitter.com/remarkablepaper), I downloaded it right now and several images and videos were downloaded.

Rootkit- commented 1 year ago

I meant that I had set it up previously and somehow deleted the folder so I do know how to setup it up properly via Cookies and bearer stuff. Okay I see what I did. Thanks guys. Close.