bellingcat / auto-archiver

Automatically archive links to videos, images, and social media content from Google Sheets (and more).
https://pypi.org/project/auto-archiver/
MIT License
578 stars 60 forks source link

TikTok downloader stalling when video is unavailable - can't reproduce #46

Closed djhmateer closed 2 years ago

djhmateer commented 2 years ago

Bug that I can't reliably reproduce but sometimes stalls the whole archiver for many hours until restarting the archiver.

Given this URL: https://www.tiktok.com/@jusscomfyyy/video/7090483393586089222

The tiktok downloader stalls.

https://github.com/krypton-byte/tiktok-downloader

The test app https://tkdown.herokuapp.com/ correctly throws an invalid url.

class TiktokArchiver(Archiver):
    name = "tiktok"

    def download(self, url, check_if_exists=False):
        if 'tiktok.com' not in url:
            return False

        status = 'success'

        try:
            # really slow for some videos here 25minutes plus or stalls
            info = tiktok_downloader.info_post(url)
            key = self.get_key(f'{info.id}.mp4')
djhmateer commented 2 years ago

I've not seen this issue for 6 months so closing for now.