Closed buratsy closed 2 years ago
nisehime
commented
2 years ago https://github.com/mikf/gallery-dl/issues/2514#issuecomment-1106864927
Twitter's search is not consistent. It doesn't return all results, very random and sometimes decides to not return anything older than X. Nothing really can be done about that other than trying again over some time,
Your link works for me. Try with Hitomi downloader.
buratsy
commented
2 years ago Which link? And what do you mean by work? Did gallery-dl download everything from the /media URL or did the advanced search give you results?
About Hitomi downloader, I remember trying to use it but it couldn't save images with their original filenames intact. Is it still the case now?
nisehime
commented
2 years ago Which link?
The search link, of course.
Did gallery-dl download everything from the /media URL or did the advanced search give you results?
Twitter's timeline returns only latest ~1000 results, it's always been like that, if you want to go deeper you need to use search (or use premium API, which costs money). Your search link gave me results, but I haven't downloaded them. But if it gives results, then it should download them fine too.
Is it still the case now?
I guess it is.
buratsy
commented
2 years ago Seems like the problem is account-related. I tried opening the search URL while logged out and it yielded very limited results (the oldest tweet was just posted on May 29, no media tweets included, and filtering for media tweets gives no results again) as opposed to none while logged in.
Do you mind telling me your account settings? I already set a non-minor birthday publicly on my profile, have the display sensitive content setting enabled, and the hide sensitive content disabled in the search settings. It used to work before but now it seems like I can only search for SFW artists. Twitter is seriously trash.
Edit: I just tried using another blank slate account with the same settings as above but I get no results on it either.
buratsy
commented
2 years ago Your search link gave me results
I forgot to ask, did these results include media tweets? The results you're seeing might be the same as the ones I see while logged out. If that's the case then maybe the issue isn't account-related after all.
nisehime
commented
2 years ago Do you mind telling me your account settings? I already set a non-minor birthday publicly on my profile, have the display sensitive content setting enabled, and the hide sensitive content disabled in the search settings.
I have all that too, except birthday (it's just not set), that's probably all the settings that can affect that. Well, I also have my country set to japan, but I doubt it plays a role. Also my acc is quite old.
did these results include media tweets?
Yes, NSFW media. The last tweet was 22 hours ago.
You might be right that its account related. But still what I said about inconsistencies of the search is also true, even I had these problems.
I suggest to try hitomi after all, just to see if it downloads older media. Also you can try proxy/VPN
buratsy
commented
2 years ago I have all that too, except birthday (it's just not set), that's probably all the settings that can affect that. Well, I also have my country set to japan, but I doubt it plays a role. Also my acc is quite old.
I set my country to Japan and now it's working again! That was seriously unexpected but thanks! I was really worried because this had been going on for a while.
aleksusklim
commented
2 years ago I set my country to Japan and now it's working again!
I'm sorry, can you tell which country was set before that?
Maybe it's country blacklist, not whitelist (so it isn't Japan that works, it's just working with any country except few specific?), since my country is set to Uzbekistan and I think that I can see NSFW images via https://twitter.com/search?f=live&q=(from%3AIgnitionCrisis)%20-filter%3Areplies&src=typed_query just fine.
buratsy
commented
2 years ago I'm sorry, can you tell which country was set before that?
Sorry, I don't remember. I was kinda in a hurry to do it so I wasn't paying attention. But a country blacklist does sound more sensible than a whitelist. Maybe it has something to do with the legal age in those countries?
Is there any way to download all of a user's media past the limit if Twitter's advanced search gives literally no results? For example, https://twitter.com/IgnitionCrisis/media says there are 2000 files. Putting that URL in gallery-dl resulted in 1320 files.
Normally, I'd save the rest through advanced search but https://twitter.com/search?q=(from%3AIgnitionCrisis) says no results and putting that URL in gallery-dl says the same thing too.