search

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites
http://ytdl-org.github.io/youtube-dl/
The Unlicense
132.72k stars 10.07k forks source link

(Not duplicate but seems fixed) YouTube Extractor not downloading latest video when downloading whole channel. #26116

Closed Tydoki closed 4 years ago

Tydoki commented 4 years ago

Checklist

Verbose log

PS C:\Scripts\Youtube Update> youtube-dl -U
youtube-dl is up-to-date (2020.06.16.1)
PS C:\Scripts\Youtube Update> youtube-dl -v -o "E:\Data Archive\Youtube Archive\OfflineTV\%(title)s.%(ext)s" https://www.youtube.com/c/OfflineTVgg/videos --download-archive OfflineTV.txt;
[debug] System config: []
[debug] User config: ['-c', '-i', '--buffer-size', '16k', '--hls-prefer-ffmpeg', '--hls-use-mpegts', '-o', 'E:\\Data Archive\\Default\\%(title)s.%(ext)s', '--no-part']
[debug] Custom config: []
[debug] Command-line args: ['-v', '-o', 'E:\\Data Archive\\Youtube Archive\\OfflineTV\\%(title)s.%(ext)s', 'https://www.youtube.com/c/OfflineTVgg/videos', '--download-archive', 'OfflineTV.txt']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2020.06.16.1
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[debug] exe versions: ffmpeg git-2019-12-08-9f7b2b3, ffprobe git-2019-12-08-9f7b2b3
[debug] Proxy map: {}
[youtube:user] OfflineTVgg: Downloading channel page
[youtube:playlist] UUDK9qD5DAQML-pzrtA7A4oA: Downloading webpage
[download] Downloading playlist: Uploads from Offline TV
[youtube:playlist] UUDK9qD5DAQML-pzrtA7A4oA: Downloading page #1
[youtube:playlist] playlist Uploads from Offline TV: Downloading 119 videos
[download] Downloading video 1 of 119
[download] HE WENT BALD?! - OFFLINETV GIVES QUARANTINE HAIRCUTS ft. Michael Reeves Scarra DisguisedToast has already been recorded in archive
[download] Downloading video 2 of 119
[download] OFFLINETV NINJA GAME TOURNAMENT (LOSERS GET TASED) has already been recorded in archive
[download] Downloading video 3 of 119
[download] OFFLINETV PLAYS DRUNK JENGA ft. Michael Reeves DisguisedToast LilyPichu Scarra Fedmyster has already been recorded in archive
[download] Downloading video 4 of 119
[download] WHY WOULD YOU SEND MICHAEL THIS?! - OFFLINETV UNBOXING has already been recorded in archive
[download] Downloading video 5 of 119
[download] HE ACTUALLY PUNCHED HER! - OFFLINETV PLAYS GANG BEASTS ft. Michael Reeves has already been recorded in archive
[download] Downloading video 6 of 119
[download] OUR DMS WERE LEAKED - GUESS THAT DM ft. DisguisedToast has already been recorded in archive
[download] Downloading video 7 of 119
[download] WE TOOK TURNS DATING EACH OTHER? - OFFLINETV PLAYS MONSTER SEEKING MONSTER ft. Michael Reeves has already been recorded in archive
[download] Downloading video 8 of 119
[download] DATING SIMULATOR 2 ft. Michael Reeves LilyPichu Scarra Pokimane has already been recorded in archive
[download] Downloading video 9 of 119
[download] OFFLINETV DON'T LAUGH CHALLENGE 3 WITH WATER (COMMUNITY CLIPS) has already been recorded in archive
[download] Downloading video 10 of 119
[download] PLEASE TELL ME YOU KNOW WHAT THAT IS - OFFLINETV UNBOXING has already been recorded in archive
[download] Downloading video 11 of 119
[download] OFFLINETV TRIES ARCHERY (FAIL) FT. Michael Reeves, Pokimane, LilyPichu, FED, DisguisedToast, Scarra has already been recorded in archive
[download] Downloading video 12 of 119
[download] OFFLINETV READS MEAN TWEETS has already been recorded in archive
[download] Downloading video 13 of 119
[download] OFFLINETV DOES A LIE DETECTOR TEST (W/ REACTIONS) has already been recorded in archive
[download] Downloading video 14 of 119
[download] YOU WON'T BELIEVE WHO TWEETED THAT l OfflineTV Guess That Tweet has already been recorded in archive
[download] Downloading video 15 of 119
[download] SHE BURST HER EARDRUM! OFFLINETV SKYDIVING FOR 1 MILLION SUBS ft. Michael Reeves LilyPichu Fedmyster has already been recorded in archive
[download] Downloading video 16 of 119
[download] DATING SIMULATOR ft. Michael Reeves LilyPichu Fedmyster Scarra has already been recorded in archive
[download] Downloading video 17 of 119
[download] IT EXPLODED! (AGAIN) - OFFLINETV CHRISTMAS UNBOXING has already been recorded in archive
[download] Downloading video 18 of 119
[download] MICHAEL REEVES JOINS OFFLINETV has already been recorded in archive
[download] Downloading video 19 of 119
[download] WHISPER CHALLENGE! ft. Michael Reeves Pokimane Scarra LilyPichu DisguisedToast Fedmyster has already been recorded in archive
[download] Downloading video 20 of 119
[download] HE GOT KNOCKED OUT! OFFLINETV TRIES DODGEBALL ft. Pokimane LilyPichu DisguisedToast Fedmyster Scarra has already been recorded in archive
[download] Downloading video 21 of 119
[download] HE GOT SO ANGRY! - OFFLINETV UNBOXING has already been recorded in archive
[download] Downloading video 22 of 119
[download] SO INTENSE!! HALLOWEEN MAFIA ft. Michael Pokimane LilyPichu DisguisedToast Fedmyster Scarra & Fuslie has already been recorded in archive
[download] Downloading video 23 of 119
[download] ANIME SPOILER PRANK ft. Fedmyster SleightlyMusical LilyPichu DisguisedToast Pokimane Scarra has already been recorded in archive
[download] Downloading video 24 of 119
[download] FRIENDSHIP TEST ft. Pokimane DisguisedToast LilyPichu Fedmyster Scarra has already been recorded in archive
[download] Downloading video 25 of 119
[download] SHE ACTUALLY STARTED CRYING! HIDE AND SEEK VS MICHAEL REEVES (LOSER GETS TASED) has already been recorded in archive
[download] Downloading video 26 of 119
[download] MINECRAFT MAFIA ft. Pokimane LilyPichu DisguisedToast Fedmyster Scarra Valkyrae xChocoBars has already been recorded in archive
[download] Downloading video 27 of 119
[download] OFFLINETV TRIES GO-KARTING has already been recorded in archive
[download] Downloading video 28 of 119
[download] SHE ACTUALLY DID IT! OFFLINETV GUESSING GAME has already been recorded in archive
[download] Downloading video 29 of 119
[download] SHE COMPLETELY LOST IT! OFFLINETV DON'T LAUGH CHALLENGE 2 (WITH WATER) has already been recorded in archive
[download] Downloading video 30 of 119
[download] THIS IS IMPOSSIBLE! OFFLINETV PLAYS PICTIONARY has already been recorded in archive
[download] Downloading video 31 of 119
[download] PLEASE DON'T SEND US THESE ANYMORE - OFFLINETV UNBOXING has already been recorded in archive
[download] Downloading video 32 of 119
[download] FEAR PONG CHALLENGE Ft. DisguisedToast Scarra Pokimane LilyPichu Fedmyster has already been recorded in archive
[download] Downloading video 33 of 119
[download] HE GOT CAUGHT LYING! MAFIA PART 5 Ft. DisguisedToast Scarra Pokimane LilyPichu Fedmyster has already been recorded in archive
[download] Downloading video 34 of 119
[download] OFFLINETV TRIES PAINTING HAIR ft. DisguisedToast, Pokimane, LilyPichu, Scarra, Fedmyster has already been recorded in archive
[download] Downloading video 35 of 119
[download] THE WHOLE THING EXPLODED! OFFLINETV FRUIT SMASHING FT. DisguisedToast Pokimane Lily Fedmyster Scarra has already been recorded in archive
[download] Downloading video 36 of 119
[download] KILL MARRY SMASH GAME OF THRONES EDITION ft. POKIMANE, TOAST, LILYPICHU, FED has already been recorded in archive
[download] Downloading video 37 of 119
[download] IS THIS THE END FOR OUR HEROES? - OFFLINE TV ODYSSEY EP 6 | A DUNGEONS AND DRAGON ADVENTURE has already been recorded in archive
[download] Downloading video 38 of 119
[download] IS DESTINY SMARTER THAN OFFLINE TV? - DETENTION AT OFFLINE HIGH EP 5 ft. POKIMANE, LILYPICHU & MORE has already been recorded in archive
[download] Downloading video 39 of 119
[download] $10,000 EASTER EGG HUNT CHALLENGE - SMASHING EGGS ON OURSELVES FT. Pokimane,  LilyPichu & more has already been recorded in archive
[download] Downloading video 40 of 119
[download] RAGE QUITTING SEKIRO | LADY BUTTERFLY BOSS FIGHT - OFFLINE TV PLAYS feat. Poki, Toast, Lily & Scarra has already been recorded in archive
[download] Downloading video 41 of 119
[download] UGG'S UNLIKELY COMPANION - OFFLINE TV ODYSSEY EP 5 | A DUNGEONS AND DRAGON ADVENTURE has already been recorded in archive
[download] Downloading video 42 of 119
[download] PROZD SLAMS YOUTUBERS & FAKE WEEBS - OFFLINE HIGH EP4 ft. LILYPICHU, FED, SCARRA, POKIMANE & TOAST has already been recorded in archive
[download] Downloading video 43 of 119
[download] THE FAKE GOBLIN HEAD - OFFLINETV ODYSSEY EP 4 | A DUNGEONS AND DRAGON ADVENTURE has already been recorded in archive
[download] Downloading video 44 of 119
[download] GIFTS FOR HOG SQUEEZING - OFFLINETV FAN MAIL UNBOXING ft. POKIMANE, TOAST, SCARRA, YVONNE & ALBERT has already been recorded in archive
[download] Downloading video 45 of 119
[download] FORTNITE STREAMER VALKYRAE YOGA BATTLES POKIMANE - OFFLINE HIGH EP3 ft. LILYPICHU, TOAST & MORE has already been recorded in archive
[download] Downloading video 46 of 119
[download] INTO THE CAVES OF PERIL - OFFLINETV ODYSSEY EP 3 | A DUNGEONS AND DRAGON ADVENTURE has already been recorded in archive
[download] Downloading video 47 of 119
[download] GTA RP, Sekiro & Stadia -  OfflineTV Podcast #7 ft. Toast, Pokimane, Albert, Yvonne has already been recorded in archive
[download] Downloading video 48 of 119
[download] GRADING OFFLINETV FAN ART ft. LILYPICHU, DISGUISEDTOAST, FEDMYSTER, SCARRA & THEEMARKZ has already been recorded in archive
[download] Downloading video 49 of 119
[download] TOAST ADMITS WHAT'S ON HIS PHONE!!! - OFFLINETV WOULD-YOU-RATHER ft. LILYPICHU, SCARRA, & ALBERT has already been recorded in archive
[download] Downloading video 50 of 119
[download] SKT DISGUISEDTOAST AND GEN.G SCARRA???  OFFLINETV PODCAST #6 ft. Toast , Fedmyster, Scarra, & MarkZ has already been recorded in archive
[download] Downloading video 51 of 119
[download] THE FIRST FIGHT - OFFLINETV ODYSSEY EP 2 | A DUNGEONS & DRAGONS ADVENTURE has already been recorded in archive
[download] Downloading video 52 of 119
[download] GIRL GAMER APPAREL & STREAMER STRUGGLES - OFFLINETV PODCAST #5 ft. LILY, TOAST, SCARRA, & ALBERT has already been recorded in archive
[download] Downloading video 53 of 119
[download] NADESHOT SCHOOLS US IN BEER PONG - DETENTION AT OFFLINE HIGH EP 2 ft. POKIMANE, LILYPICHU & MORE has already been recorded in archive
[download] Downloading video 54 of 119
[download] KILL, MARRY, SMASH - APEX LEGENDS, POKEMON & MORE ft. POKIMANE, LILYPICHU, XELL & YVONNE has already been recorded in archive
[download] Downloading video 55 of 119
[download] A FRESH START - OFFLINETV ODYSSEY EP 1 | A DUNGEONS & DRAGONS ADVENTURE has already been recorded in archive
[download] Downloading video 56 of 119
[download] RETIREMENT?? NEW POKEMON?? - OFFLINETV PODCAST #4 ft. POKIMANE, LILYPICHU, YVONNE, & XELL has already been recorded in archive
[download] Downloading video 57 of 119
[download] DEMONITIZATION, GORDAN HAYWARD & MORE - OFFLINETV PODCAST #3 ft. TOAST, FED, SCARRA, & ALBERT has already been recorded in archive
[download] Downloading video 58 of 119
[download] WE FOUND WHAT IN TOASTS ROOM??? - OFFLINETV FAN Q&A ft. DISGUISEDTOAST, POKIMANE, YASSUO & SCARRA has already been recorded in archive
[download] Downloading video 59 of 119
[download] VALENTINES DAY, VACATIONS & SPECIAL GUEST YASSUO - OFFLINETV PODCAST#2 ft. TOAST, POKIMANE, SCARRA has already been recorded in archive
[download] Downloading video 60 of 119
[download] THIS GIFT IS IMPOSSIBLE TO OPEN?! OFFLINETV FAN UNBOXING ft. LILYPICHU, FEDMYSTER, SCARRA & MORE has already been recorded in archive
[download] Downloading video 61 of 119
[download] Mulan Star Jimmy Wong Teaches Us To Be A Man | Detention at Offline High Ep 1 has already been recorded in archive
[download] Downloading video 62 of 119
[download] Lily Thinks Stalker is Cute, Japan Trip Leak, & More - OTV PODCAST #1 has already been recorded in archive
[download] Downloading video 63 of 119
[download] OFFLINETV NEW CONTENT TRAILERS & ANNOUNCEMENTS has already been recorded in archive
[download] Downloading video 64 of 119
[download] DON'T LAUGH CHALLENGE | ft. Lilypichu, DisguisedToast, Scarra, & More has already been recorded in archive
[download] Downloading video 65 of 119
[download] ULTIMATE JENGA - PUNISHMENT: TWERKING ft. POKIMANE, DISGUISEDTOAST, FEDMYSTER, & SCARRA has already been recorded in archive
[download] Downloading video 66 of 119
[download] WE GOT GLITTER BOMB PRANKED | OFFLINETV HOLIDAY FAN UNBOXING ft. TOAST, FED, POKI, SCARRA, LILY has already been recorded in archive
[download] Downloading video 67 of 119
[download] OFFLINETV BEACH EPISODE & VOLLEYBALL šŸŒ“ ft. Pokimane, Lilypichu, DisguisedToast, Scarra, Fedmyster has already been recorded in archive
[download] Downloading video 68 of 119
[download] OUR DIRTIEST UNBOXING EVER | OFFLINETV FAN MAIL UNBOXING ft. TOAST, POKI, LILYPICHU, SCARRA, FED has already been recorded in archive
[download] Downloading video 69 of 119
[download] OFFLINETV EMOTIONAL THANKSGIVING MUKBANG has already been recorded in archive
[download] Downloading video 70 of 119
[download] OFFLINETV TWITCHCON VLOG & TOAST'S REACTION TO NEW HOUSE has already been recorded in archive
[download] Downloading video 71 of 119
[download] THE RETURN OF THE KING | OFFLINETV MAFIA & MYSTERY BOX OPENED has already been recorded in archive
[download] Downloading video 72 of 119
[download] PUMPKIN CARVING WITH SWORDS | OFFLINETV HALLOWEEN SPECIAL ft. LILYPICHU, SCARRA FED, & MORE has already been recorded in archive
[download] Downloading video 73 of 119
[download] OFFLINETV NEEDS NEW MEMBERS?! | FAN MAIL Q&A has already been recorded in archive
[download] Downloading video 74 of 119
[download] DID HE BREAK HIS NOSE?!? STREAMERS PLAY SOCCER ft. SCARRA, POKIMANE, LILYPICHU, FEDMYSTER & MORE has already been recorded in archive
[download] Downloading video 75 of 119
[download] WTF DID YOU GUYS SEND US?? | OFFLINETV FAN MAIL UNBOXING has already been recorded in archive
[download] Downloading video 76 of 119
[download] LILYPICHU VS SCARRA 200 IQ DEATHMATCH: OFFLINE TV PLAYS CODENAMES has already been recorded in archive
[download] Downloading video 77 of 119
[download] WHAT KIND OF HINT IS THAT??? OFFLINETV HEADS-UP ft. SCARRA, POKIMANE, FEDMYSTER, LILYPICHU & MORE has already been recorded in archive
[download] Downloading video 78 of 119
[download] WE HIT 500K SUBSCRIBERS!!! has already been recorded in archive
[download] Downloading video 79 of 119
[download] SHURIKEN, KUNAI, & WEAPONS OH MY! OFFLINETV FAN MAIL UNBOXING has already been recorded in archive
[download] Downloading video 80 of 119
[download] NEVER HAVE I EVER 2 | OFFLINETV EDITION ft. DISGUISEDTOAST, LILYPICHU, POKIMANE, SCARRA, FED & MORE has already been recorded in archive
[download] Downloading video 81 of 119
[download] THE CRAZIEST JENGA GAME ft. POKIMANE, LILYPICHU, SCARRA, FEDMYSTER, ALBERT & MORE has already been recorded in archive
[download] Downloading video 82 of 119
[download] BIGGEST SAVE EVER? OFFLINETV MAFIA w/ SPECIAL GUEST has already been recorded in archive
[download] Downloading video 83 of 119
[download] WE CAN'T ANSWER THAT!!! OFFLINETV FAN Q+A has already been recorded in archive
[download] Downloading video 84 of 119
[download] DRUNK PAINTING CLASS W/ OFFLINETV ft. LILYPICHU, SCARRA, POKIMANE, FEDMYSTER & MORE has already been recorded in archive
[download] Downloading video 85 of 119
[download] OFFLINETV SEASON 2 PREMIERE | HOUSE TOUR & MEET THE CAST ft. POKI, TOAST, LILY, FED, & SCARRA has already been recorded in archive
[download] Downloading video 86 of 119
[download] OfflineTV Changes & Updates has already been recorded in archive
[download] Downloading video 87 of 119
[download] Offline TV Vive Game Trailer has already been recorded in archive
[download] Downloading video 88 of 119
[download] OFFLINE TV FINDS A NEW HOUSE brought to you by Purple Mattress has already been recorded in archive
[download] Downloading video 89 of 119
[download] OFFLINETV SKYDIVE PRANK! SHE THOUGHT WE WERE GOING TO SIX FLAGS! has already been recorded in archive
[download] Downloading video 90 of 119
[download] BATTLESHIPS FT. JOAST, FOKI, LIBERTY, and $ELLOUT$? has already been recorded in archive
[download] Downloading video 91 of 119
[download] WHY DO PEOPLE SEND US WEAPONS??? OfflineTV Fan Unboxing has already been recorded in archive
[download] Downloading video 92 of 119
[download] SINGING IN PUBLIC (POORLY) | OFFLINETV & FRIENDS TRY KARAOKE has already been recorded in archive
[download] Downloading video 93 of 119
[download] OFFLINETV HOUSE BEST MOMENTS: TAIWAN has already been recorded in archive
[download] Downloading video 94 of 119
[download] T-PAIN VISITS OFFLINETV ft. Fedmyster, Lilypichu, Scarra, Pokimane, DisguisedToast, Yoona & Mendo has already been recorded in archive
[download] Downloading video 95 of 119
[download] OFFLINETV REVEALS HOUSE SECRETS (Q&A from Fans) has already been recorded in archive
[download] Downloading video 96 of 119
[download] DISGUISED TOAST FINDS LOVE l OFFLINETV DATING SHOW has already been recorded in archive
[download] Downloading video 97 of 119
[download] DON'T LAUGH CHALLENGE l OFFLINETV has already been recorded in archive
[download] Downloading video 98 of 119
[download] TWO GIRLS ONE YOONA l MAFIA RETURNS: OFFLINETV EDITION ft. Disguised Toast, Pokimane, LilyPichu etc has already been recorded in archive
[download] Downloading video 99 of 119
[download] OFFLINETV RUINS WEDDING Ft. Pokelawls, Disguised Toast, Pokimane, LilyPichu and Scarra has already been recorded in archive
[download] Downloading video 100 of 119
[download] SOMEONE SENT US AN ACTUAL SPEAR WTF! l OfflineTV Holiday Fan Mail! šŸŽ„ has already been recorded in archive
[download] Downloading video 101 of 119
[download] Kill Marry Smash: Hearthstone Edition ft. Disguised Toast, LilyPichu, Scarra, and MarkZ has already been recorded in archive
[download] Downloading video 102 of 119
[download] POKIMANE'S BOYFRIEND JOINS THE OFFLINE HOUSE? - OfflineTV Tries Improv Comedy! has already been recorded in archive
[download] Downloading video 103 of 119
[download] POKIMANE, LILYPICHU, AND FED GO MISSING!! (Six Flags Trip) has already been recorded in archive
[download] Downloading video 104 of 119
[download] TYLER1 JOINS OFFLINE TV?? BEST TWITCH CON MOMENTS has already been recorded in archive
[download] Downloading video 105 of 119
[download] DISGUISED TOAST JOINS THE OFFLINE HOUSE! has already been recorded in archive
[download] Downloading video 106 of 119
[download] WE'RE RECRUITING (THANK YOU FOR 100K SUBSCRIBERS) has already been recorded in archive
[download] Downloading video 107 of 119
[download] THE MOST SAVAGE MAFIA GAME (ever?) ft. Pokimane, Scarra, LilyPichu, Mendokusaii & more has already been recorded in archive
[download] Downloading video 108 of 119
[download] COUPLES MINI-GOLF ft. Pokimane, LilyPichu, Scarra, Based Yoona and more has already been recorded in archive
[download] Downloading video 109 of 119
[download] MARIACHI BAND HOUSE PRANK ft. LilyPichu Scarra Pokimane has already been recorded in archive
[download] Downloading video 110 of 119
[download] WIRELESS KEYBOARD HOUSE PRANK ft. Pokimane & LilyPichu has already been recorded in archive
[download] Downloading video 111 of 119
[download] NEVER HAVE I EVER ft. Scarra, Pokimane, LilyPichu, Mendokusaii and more has already been recorded in archive
[download] Downloading video 112 of 119
[download] Offline TV plays One Two Switch ft. Scarra, LilyPichu, Pokelawls, BasedYoona and more has already been recorded in archive
[download] Downloading video 113 of 119
[download] Streamers Try: Rock Climbing ft. Scarra, LilyPichu, Pokelawls, Based Yoona, TheeMarkz, and Xell has already been recorded in archive
[download] Downloading video 114 of 119
[download] OFFLINE TV Plays Drawful ft. Pokimane, Scarra, Lilypichu, Pokelawls, and Based Yoona. has already been recorded in archive
[download] Downloading video 115 of 119
[download] SMASH OR PASS: League of Legends Edition ft. Pokimane, Scarra, Pokelawls, Based Yoona has already been recorded in archive
[download] Downloading video 116 of 119
[download] Streamers Try: Boxing ft. Scarra, Pokimane, LilyPichu, Pokelawls & BasedYoona has already been recorded in archive
[download] Downloading video 117 of 119
[download] Anime Expo 2017 ft. Scarra, Pokimane, LilyPichu, Pokelawls, Based Yoona, Fedmyster, MarkZ, and Xell has already been recorded in archive
[download] Downloading video 118 of 119
[download] MEET THE OFFLINE TV HOUSE [SEASON 1] has already been recorded in archive
[download] Downloading video 119 of 119
[download] Introducing Offline TV has already been recorded in archive
[download] Finished downloading playlist: Uploads from Offline TV

Description

When downloading whole YouTube channel the latest uploaded video does not get downloaded. I have tested this on a few channels where the latest uploaded video has ranged from 1 hour ago to 7 hours ago.

image

The image provided is to compare the latest video uploaded on the channel to the first video youtube-dl decides to check in the command/verbose log posted above.

itkfilelor commented 4 years ago

I second this, it seems to be arbitrary which videos are available. e.g. its not always the most recently uploaded. e.g. I have a script that runs daily. On one of the channels, assuming there are 10 new videos on this channel for today, video 4 and 7 were the only 2 to be recognized as existing, let alone downloaded. This first happened 7/24. Script is ran via cron at 2340 EDT nightly. Videos were still not found the following afternoon (7/25)

I tried to look into the HTML (assuming that is how the videos are found based on what i saw in the YDL source) to find if there are any differences between the video links that were found vs those that were not, and I could not see anything.

Update: Running the script manually today(7/26), only some of the videos from 7/24 are populating when running the script, most are not. This is true for the 15 (lol) channels I monitor daily. I am basing my findings on the found video id's when the channel page is initially downloaded to scan for matching date/filter preferences. Playlist pages (only using one at this time) seem to be populating as expected.

More Updates: I think I see what is happening. Using OP's channel example and cross checked against 3 of mine:

The given link is: https://www.youtube.com/c/OfflineTVgg/videos What YDL is using is: https://www.youtube.com/playlist?list=UUDK9qD5DAQML-pzrtA7A4oA which is the channel's UPLOADS playlist. for some reason YouTube, or the creator(s), are not populating EVERY video for the day. I can only hypothesize it has something to do with a change in the publish/recommendation algorithms.

Searching for a workaround, will post back.

itkfilelor commented 4 years ago

The "offending" code seems to be in youtube.py per the comment `

Channel by page listing is restricted to 35 pages of 30 items, i.e. 1050 videos total (see #5778)

    # Workaround by extracting as a playlist if managed to obtain channel playlist URL
    # otherwise fallback on channel by page extraction

on lines [2956-2958](https://github.com/ytdl-org/youtube-dl/blob/a115e07594ccb7749ca108c889978510c7df126e/youtube_dl/extractor/youtube.py#L2956) this behavior is intentional. I am trying to find the specific place where it makes the change (i'm still barely an intermediate in python) to the playlist vs the channel page. I am looking at adding a key--force-channel-page` and then a bool statement to skip the playlist page swap if 'True' This way it will only do it if the user chooses and not by default.

edit: added links to comment and module

Update: I'm probably wrong, sigh.

itkfilelor commented 4 years ago

None of today's videos seem to have been added, but all of the videos up until yesterday seem to have been appropriately populated. This is annoying.. lol

Tydoki commented 4 years ago

The "offending" code seems to be in youtube.py per the comment Channel by page listing is restricted to 35 pages of 30 items, i.e. 1050 videos total (see #5778) # Workaround by extracting as a playlist if managed to obtain channel playlist URL # otherwise fallback on channel by page extraction on lines 2956-2958

yeah probably not the issue since the channel I used has only like 120 videos ...

Yeah the latest video was finally added to the upload playlist for the channel I used (OfflineTV) like 6-22 hours later Problem still exists though from testing on channels with new uploads

Tydoki commented 4 years ago

This isn't really a duplicate of https://github.com/ytdl-org/youtube-dl/issues/26056

But the problem is probably caused by the same issue.

jrowens commented 4 years ago

Actually, I'm pretty sure that it's something wrong on YouTube's end. I was on the verge of submitting this bug report myself, but then I found that, if you go to the channel's 'Videos' tab, and then click the 'play all', you get a playlist that starts playing their actually most recent video, but the playlist on the side shows that it thinks you're currently playing the most recent video that youtube-dl sees, and labels it #1 on the list, and the actually newest isn't there at all, even though it's playing it right there. I'm used to waiting 20 minutes to an hour for uploaded/published videos to be listed on the playlists, but this has been pretty different from that, since about Thursday or Friday. I did submit it as a 'feedback' (the closest thing I can find to a bug report there) to YouTube.

itkfilelor commented 4 years ago

Everything was 'normal' as of 2340 last night, as all my podcasts were available this morning ;-)

On Mon, Jul 27, 2020 at 7:26 AM J. Randall Owens notifications@github.com wrote:

Actually, I'm pretty sure that it's something wrong on YouTube's end. I was on the verge of submitting this bug report myself, but then I found that, if you go to the channel's 'Videos' tab, and then click the 'play all', you get a playlist that starts playing their actually most recent video, but the playlist on the side shows that it thinks you're currently playing the most recent video that youtube-dl sees, and labels it #1 https://github.com/ytdl-org/youtube-dl/issues/1 on the list, and the actually newest isn't there at all, even though it's playing it right there. I'm used to waiting 20 minutes to an hour for uploaded/published videos to be listed on the playlists, but this has been pretty different from that, since about Thursday or Friday. I did submit it as a 'feedback' (the closest thing I can find to a bug report there) to YouTube.

ā€” You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ytdl-org/youtube-dl/issues/26116#issuecomment-664339813, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGI5SH2TPOQ67UCQ3BQTXOLR5VP57ANCNFSM4PHVJ5WQ .

Tydoki commented 4 years ago

Issue seems fixed? I checked like 10 channels with new videos and their videos seem to be on the upload playlist.

Tydoki commented 4 years ago

https://github.com/ytdl-org/youtube-dl/issues/26056 seems to still not be fixed though. Maybe it wasn't related.

This was not a duplicate but it seems fixed.