mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.64k stars 950 forks source link

[twitter] is this right config setting? (+suspension question #6311

Open mmoisall opened 6 days ago

mmoisall commented 6 days ago

my goal is to get all media from user. for example download all image and video in "https://x.com/dknrbssntri/media" would be good if gallery-dl search to only the media posts, no retweets and text only tweets.

wonder why it keeps running even when it reaches to existing previously downloaded image. it just spend more minutes doing nothing before end downloading. i want to stop gdl instant when it reaches already downloaded image. what is the option for that?

gallery-dl --filter "datetime(2024,9,29,4,38,24) <= date" http://x.com/intent/user?user_id=3120329819
[cookies][info] Extracted 45 cookies from Firefox
.\gallery-dl\twitter - 3120329819 - taracod -\2024-09-29 044237 - dknrbssntri - twitter - 1840250808472088725-1(GYnh2n4asAA6tg3).jpg

-my twitter config

"twitter": {
  "directory": ["twitter - {user[id]} - {user[nick]} -"],
  "filename": "{date:%Y-%m-%d %H%M%S} - {user[name]} - twitter - {tweet_id}-{num}({filename}).{extension}",
  "cookies": ["firefox"],
  "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:131.0) Gecko/20100101 Firefox/131.0",
  "sleep": [1.5, 5],
  "sleep-request": [6.0, 12.0],
  "ratelimit": "wait:1000",
  "locked": "wait",
  "conversations": true,
  "size": "orig",
  "user": "media",
  "twitpic": true,
  "text-tweets": false,
  "metadata": true
},

-twitter suspending question downloading media of a single user a lot doesn't usually get suspend but downloading few(1~10) from many users each get ben easily why is this?

also please give some advice for account suspension

someonenameguy commented 6 days ago

My config looks like this. [I'm using on Termux(Android app)]

"twitter": {
    "logout": true,
    "#username": "#",
    "#password": "#",
    "cookies": {
        "auth_token": "#"
     },
    "cards": false,
    "include": "media",
    "expand": false,
    "quotes": true,
    "quoted": true,
    "retweets": false,
    "replies": "self",
    "conversations": false,
    "transform": true,
    "syndication": "extended",
    "users": "",
    "text-tweets": false,
    "twitpic": true,
    "videos": true,
    "unique": false,
    "sleep": [1.3,8],
    "sleep-request": [5,8],
    "user-agent": "Mozilla/5.0 (Android 14; Mobile; rv:131.0) Gecko/131.0 Firefox/131.0"
},
I have downloaded from many different users, sometimes two in parallel and have not been suspended. ![Screenshot](https://github.com/user-attachments/assets/a5328715-26f5-4708-ae1e-fec3672d392f)
mmoisall commented 5 days ago

following your config actually improved downloading now its like 10times faster lol it was helpful thanks

+ I wonder what is "syndication"

someonenameguy commented 4 days ago

I wonder what is "syndication"

It an old option not used anymore. https://github.com/mikf/gallery-dl/commit/92ff99c8e55910ecb0c91d7cac67c76a336324dd