blackjack4494 / yt-dlc

media downloader and library for various sites.
The Unlicense
2.89k stars 363 forks source link

[Broken] TikTok channel page #195

Open AlphaSlayer1964 opened 3 years ago

AlphaSlayer1964 commented 3 years ago

Checklist

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.tiktok.com/@tiktok']
[debug] Loading archive file None
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dlc version 2020.11.11-3
[debug] Python version 3.8.6 (CPython) - Windows-10-10.0.19041-SP0
[debug] exe versions: ffmpeg 4.3.1-2020-09-21-full_build-www.gyan.dev, ffprobe 4.3.1-2020-09-21-full_build-www.gyan.dev, phantomjs 2.1.1
[debug] Proxy map: {}
[generic] @tiktok: Requesting header
WARNING: Falling back on generic information extractor.
[generic] @tiktok: Downloading webpage
[generic] @tiktok: Extracting information
ERROR: Unsupported URL: https://www.tiktok.com/@tiktok
Traceback (most recent call last):
  File "youtube_dlc\YoutubeDL.py", line 830, in extract_info
  File "youtube_dlc\extractor\common.py", line 532, in extract
  File "youtube_dlc\extractor\generic.py", line 3382, in _real_extract
youtube_dlc.utils.UnsupportedError: Unsupported URL: https://www.tiktok.com/@tiktok

Description

First I know titktok seems to always break but I still wanted to ask. youtube-dlc doesn't download all the videos of a given tiktok page. Individual videos work but not entire pages.

maxvdmerwe commented 3 years ago

Hello, apologies for linking outside of this project however the following GitHub project does currently allow you to download a TikTok user's content.

https://github.com/drawrowfly/tiktok-scraper/

maxvdmerwe commented 3 years ago

Hello, you can install it using npm then run it as a standard program on linux. On 17 Nov 2020, 22:46 +0200, fosam notifications@github.com, wrote:

Hi, it is not packaged, it has to be compiled? — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

AlphaSlayer1964 commented 3 years ago

Ya I used that for a bit but it always breaks for me. Even when I only use one user and tell it to only scrape the first 20 posts.

maxvdmerwe commented 3 years ago

Your issue sounds very odd, I have used it to download 2600 videos from a single account.

The command I used,

tiktok-scraper user USERNAME --hd -a 10 -d -t "csv" -w On 18 Nov 2020, 07:08 +0200, AplhaSlayer1964 notifications@github.com, wrote:

Ya I used that for a bit but it always breaks for me. Even when I only use one user and tell it to only scrape the first 20 posts. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

AlphaSlayer1964 commented 3 years ago

@sjvdmerwe I will see if it needs to be updates and try messing with it a bit more. Doing some testing they're probably gonna need to do a lot of background stuff to get tiktok fully working as even if you feed it a bunch of links you get rate limited really fast it seems. (for ytdlc)