search

jmbannon / ytdl-sub

Lightweight tool to automate downloading and metadata generation with yt-dlp
https://ytdl-sub.readthedocs.io
GNU General Public License v3.0
1.58k stars 60 forks source link

[Curiositystream] Need to bypass default match filters #963

Open dfein38347g opened 2 months ago

dfein38347g commented 2 months ago

I can't download things from curiosity stream and it seems to be due to the default match filters. I tried to bypass them by calling the match filters plugin and leaving it blank, but that didn't work.

Format of below:

CuriosityStream4k:
  preset:
    - "curiositystream"
  overrides:
    tv_show_name: "Curiosity Stream"
    url: "https://curiositystream.com/collections/13"
# This config uses prebuilt presets included with ytdl-sub to download and format
# channels from YouTube or other sites supported by yt-dlp into a TV show for
# your favorite player. The directory format will look something like
#
#   /tv_shows
#       /Season 2021
#           s2021.e0317 - Pattys Day Video-thumb.jpg
#           s2021.e0317 - Pattys Day Video.mp4
#           s2021.e0317 - Pattys Day Video.nfo
#       /Season 2022
#           s2022.e1225 - Merry Christmas-thumb.jpg
#           s2022.e1225 - Merry Christmas.mp4
#           s2022.e1225 - Merry Christmas.nfo
#       poster.jpg
#       fanart.jpg
#       tvshow.nfo
#
# The idea is to use dates as numerics to represent season and episode numbers.
configuration:
  working_directory: '.ytdl-sub-downloads'

presets:

  # Your main TV show preset - all your tv show subscriptions will use this.
  tv_show:
    preset:
      # Choose one of the following player types:
      # - "kodi_tv_show_by_date"
      # - "jellyfin_tv_show_by_date"
      # - "plex_tv_show_by_date"

      - "jellyfin_tv_show_by_date"  # replace with desired player type

      # Choose one of the following season/episode formats:
      # - "season_by_year__episode_by_month_day"
      # - "season_by_year_month__episode_by_day"
      # - "season_by_year__episode_by_month_day_reversed"
      # - "season_by_year__episode_by_download_index"

      - "season_by_year__episode_by_month_day_reversed"  # replace with desired season/episode format

      # Include any of the presets listed below in your 'main preset' if you want
      # it applied to every TV show. Or, use them on the individual subscriptions.
      # - "only_recent_videos"
      - "add_subtitles"
      - "sponsorblock"
      - "include_info_json"

    # To download age-restricted videos, you will need to uncomment and set your cookie
    # file here as a ytdl parameter. For more info, see
    # https://ytdl-sub.readthedocs.io/en/latest/faq.html#download-age-restricted-youtube-videos
    #
    # ytdl_options:
    #   cookiefile: "/config/cookie_file.txt"  # replace with actual cookie file path

    overrides:
      tv_show_directory: "/tv_shows"  # replace with path to tv show directory
      # Fields in the prebuilt preset that can be changed:
      #
      episode_file_name: "{upload_date_standardized} - {title_sanitized}"
      episode_title: "{upload_date_standardized} - {title}"
      episode_plot: "{description}"  # source variable for the video description is {description}
    chapters:
      embed_chapters: True
    ytdl_options:
      format: "bestvideo[height<=1440]+bestaudio/mp4"
      cookies: "/config/cookies.txt"

  curiositystream:
    preset:
      # Choose one of the following player types:
      # - "kodi_tv_show_by_date"
      # - "jellyfin_tv_show_by_date"
      # - "plex_tv_show_by_date"

      - "jellyfin_tv_show_by_date"  # replace with desired player type

      # Choose one of the following season/episode formats:
      # - "season_by_year__episode_by_month_day"
      # - "season_by_year_month__episode_by_day"
      # - "season_by_year__episode_by_month_day_reversed"
      # - "season_by_year__episode_by_download_index"

      - "season_by_year__episode_by_month_day_reversed"  # replace with desired season/episode format

      # Include any of the presets listed below in your 'main preset' if you want
      # it applied to every TV show. Or, use them on the individual subscriptions.
      # - "only_recent_videos"
      - "add_subtitles"
      - "sponsorblock"
      - "include_info_json"

    # To download age-restricted videos, you will need to uncomment and set your cookie
    # file here as a ytdl parameter. For more info, see
    # https://ytdl-sub.readthedocs.io/en/latest/faq.html#download-age-restricted-youtube-videos
    #
    # ytdl_options:
    #   cookiefile: "/config/cookie_file.txt"  # replace with actual cookie file path

    overrides:
      tv_show_directory: "/tv_shows"  # replace with path to tv show directory
      # Fields in the prebuilt preset that can be changed:
      #
      episode_file_name: "{upload_date_standardized} - {title_sanitized}"
      episode_title: "{upload_date_standardized} - {title}"
      episode_plot: "{description}"  # source variable for the video description is {description}
    match_filters:
      filters:
    throttle_protection:
      sleep_per_download_s:
        min: 30.8
        max: 353.2
      sleep_per_subscription_s:
        min: 25.3
        max: 245.1
    chapters:
      embed_chapters: True
    ytdl_options:
      format: "bestvideo+bestaudio/mp4"
      cookies: "/config/cookies.txt"
      sleep_interval_requests: 30
      username: "nathan91hunt@gmail.com"
      password: "*****"
      noplaylist:
      nocheckcertificate:
      cookiefile: "/config/cookies.txt"

  tv_show_kids:
    preset:
      # Choose one of the following player types:
      # - "kodi_tv_show_by_date"
      # - "jellyfin_tv_show_by_date"
      # - "plex_tv_show_by_date"

      - "jellyfin_tv_show_by_date"  # replace with desired player type

      # Choose one of the following season/episode formats:
      # - "season_by_year__episode_by_month_day"
      # - "season_by_year_month__episode_by_day"
      # - "season_by_year__episode_by_month_day_reversed"
      # - "season_by_year__episode_by_download_index"

      - "season_by_year__episode_by_month_day_reversed"  # replace with desired season/episode>

      # Include any of the presets listed below in your 'main preset' if you want
      # it applied to every TV show. Or, use them on the individual subscriptions.
      # - "only_recent_videos"
      - "add_subtitles"
      - "sponsorblock"
      - "include_info_json"

    # To download age-restricted videos, you will need to uncomment and set your cookie
    # file here as a ytdl parameter. For more info, see
    # https://ytdl-sub.readthedocs.io/en/latest/faq.html#download-age-restricted-youtube-videos    #
    # ytdl_options:
    #   cookiefile: "/config/cookie_file.txt"  # replace with actual cookie file path

    overrides:
      tv_show_directory: "/kids"  # replace with path to tv show directory
      # Fields in the prebuilt preset that can be changed:
      #
      episode_file_name: "{upload_date_standardized} - {title_sanitized}"
      episode_title: "{upload_date_standardized} - {title}"
      episode_plot: "{description}"  # source variable for the video description is {descripti>    ytdl_options:
      format: "bestvideo[height<=1440]+bestaudio/mp4"

####################################################################################################

  # Preset to only download and keep recent videos
  only_recent_videos:

    # Only download videos within the download_range
    date_range:
      after: "today-{download_range}"

    # Stops fetching metadata if the video is out of range (saves time + bandwidth)
    ytdl_options:
      break_on_reject: False

    # Deletes any videos older than download_range. WARNING: do not use
    # "season_by_year__episode_by_download_index" if you plan to delete older videos
    output_options:
      keep_files_after: "today-{download_range}"

    # Set the duration of download_range, defaults to 2 months
    overrides:
      download_range: "6months"

####################################################################################################

  # Preset to download subtitles (either by file or embedded)
  add_subtitles:
    subtitles:
      # Embed subtitles into the video
      embed_subtitles: True
      # And/or download them as a file. Uncomment to download as file:
      # subtitles_name: "{episode_file_path}.{lang}.{subtitles_ext}"
      # subtitles_type: "srt"

      languages: "en"  # supports list of multiple languages
      allow_auto_generated_subtitles: True  # allow auto subtitles

####################################################################################################

  # Preset to cut sponsor segments from videos
  sponsorblock:
    # If you download using cron, it is wise to add a delay before downloading ad-filled content to
    # give folks time to submit sponsor segments. Uncomment to wait 2 days before download a video.
    date_range:
     before: "today-2days"

    chapters:
      # Remove all of these sponsorblock categories
      sponsorblock_categories:
        - "intro"
        - "outro"
        - "selfpromo"
        - "preview"
        - "interaction"
        - "sponsor"
        - "music_offtopic"
      remove_sponsorblock_categories: "all"
      force_key_frames: False

####################################################################################################

  # Preset for the hoarders who want to also save the info.json file
  include_info_json:
    output_options:
      info_json_name: "{episode_file_path}.{info_json_ext}"


[ytdl-sub] Beginning subscription download for CuriosityStream4k
[ytdl-sub] Subscription full yaml:
presets:
  CuriosityStream4k:
    chapters:
      embed_chapters: true
      force_key_frames: false
      remove_sponsorblock_categories: all
      sponsorblock_categories:
      - intro
      - outro
      - selfpromo
      - preview
      - interaction
      - sponsor
      - music_offtopic
    date_range:
      before: today-2days
    download:
    - playlist_thumbnails:
      - name: '{avatar_uncropped_thumbnail_file_name}'
        uid: avatar_uncropped
      - name: '{banner_uncropped_thumbnail_file_name}'
        uid: banner_uncropped
      source_thumbnails:
      - name: '{avatar_uncropped_thumbnail_file_name}'
        uid: avatar_uncropped
      - name: '{banner_uncropped_thumbnail_file_name}'
        uid: banner_uncropped
      url: '{url}'
    - url: '{url2}'
    - url: '{url3}'
    - url: '{url4}'
    - url: '{url5}'
    - url: '{url6}'
    - url: '{url7}'
    - url: '{url8}'
    - url: '{url9}'
    - url: '{url10}'
    - url: '{url11}'
    - url: '{url12}'
    - url: '{url13}'
    - url: '{url14}'
    - url: '{url15}'
    - url: '{url16}'
    - url: '{url17}'
    - url: '{url18}'
    - url: '{url19}'
    - url: '{url20}'
    - url: '{url21}'
    - url: '{url22}'
    - url: '{url23}'
    - url: '{url24}'
    - url: '{url25}'
    - url: '{url26}'
    - url: '{url27}'
    - url: '{url28}'
    - url: '{url29}'
    - url: '{url30}'
    - url: '{url31}'
    - url: '{url32}'
    - url: '{url33}'
    - url: '{url34}'
    - url: '{url35}'
    - url: '{url36}'
    - url: '{url37}'
    - url: '{url38}'
    - url: '{url39}'
    - url: '{url40}'
    - url: '{url41}'
    - url: '{url42}'
    - url: '{url43}'
    - url: '{url44}'
    - url: '{url45}'
    - url: '{url46}'
    - url: '{url47}'
    - url: '{url48}'
    - url: '{url49}'
    - url: '{url50}'
    - url: '{url51}'
    - url: '{url52}'
    - url: '{url53}'
    - url: '{url54}'
    - url: '{url55}'
    - url: '{url56}'
    - url: '{url57}'
    - url: '{url58}'
    - url: '{url59}'
    - url: '{url60}'
    - url: '{url61}'
    - url: '{url62}'
    - url: '{url63}'
    - url: '{url64}'
    - url: '{url65}'
    - url: '{url66}'
    - url: '{url67}'
    - url: '{url68}'
    - url: '{url69}'
    - url: '{url70}'
    - url: '{url71}'
    - url: '{url72}'
    - url: '{url73}'
    - url: '{url74}'
    - url: '{url75}'
    - url: '{url76}'
    - url: '{url77}'
    - url: '{url78}'
    - url: '{url79}'
    - url: '{url80}'
    - url: '{url81}'
    - url: '{url82}'
    - url: '{url83}'
    - url: '{url84}'
    - url: '{url85}'
    - url: '{url86}'
    - url: '{url87}'
    - url: '{url88}'
    - url: '{url89}'
    - url: '{url90}'
    - url: '{url91}'
    - url: '{url92}'
    - url: '{url93}'
    - url: '{url94}'
    - url: '{url95}'
    - url: '{url96}'
    - url: '{url97}'
    - url: '{url98}'
    - url: '{url99}'
    - url: '{url100}'
    match_filters:
      filters: null
    nfo_tags:
      nfo_name: '{episode_file_path}.nfo'
      nfo_root: episodedetails
      tags:
        aired: '{episode_date_standardized}'
        episode: '{episode_number}'
        genre:
        - '{tv_show_genre}'
        mpaa: '{episode_content_rating}'
        plot: '{episode_plot}'
        season: '{season_number}'
        title: '{episode_title}'
        year: '{episode_year}'
    output_directory_nfo_tags:
      nfo_name: tvshow.nfo
      nfo_root: tvshow
      tags:
        genre:
        - '{tv_show_genre}'
        mpaa: '{tv_show_content_rating}'
        title: '{tv_show_name}'
    output_options:
      file_name: '{episode_file_path}.{ext}'
      info_json_name: '{episode_file_path}.{info_json_ext}'
      maintain_download_archive: true
      output_directory: '{tv_show_directory}/{tv_show_name_sanitized}'
      thumbnail_name: '{thumbnail_file_name}'
    overrides:
      avatar_uncropped_thumbnail_file_name: '{tv_show_poster_file_name}'
      banner_uncropped_thumbnail_file_name: '{tv_show_fanart_file_name}'
      episode_content_rating: '{tv_show_content_rating}'
      episode_date_standardized: '{upload_date_standardized}'
      episode_file_name: '{upload_date_standardized} - {title_sanitized}'
      episode_file_path: '{season_directory_name_sanitized}/{episode_file_name_sanitized}'
      episode_number: '{upload_day_of_year_reversed}{upload_date_index_reversed_padded}'
      episode_number_padded: '{upload_day_of_year_reversed_padded}{upload_date_index_reversed_padded}'
      episode_plot: '{description}'
      episode_title: '{upload_date_standardized} - {title}'
      episode_year: '{upload_year}'
      file_title: '{title_sanitized}'
      file_uid: '{uid_sanitized}'
      season_directory_name: Season {season_number_padded}
      season_number: '{upload_year}'
      season_number_padded: '{season_number}'
      season_poster_file_name: season{season_number_padded}-poster.jpg
      subscription_indent_1: '{tv_show_genre_default}'
      subscription_indent_2: '{tv_show_content_rating_default}'
      subscription_value: ''
      subscription_value_10: ''
      subscription_value_100: ''
      subscription_value_11: ''
      subscription_value_12: ''
      subscription_value_13: ''
      subscription_value_14: ''
      subscription_value_15: ''
      subscription_value_16: ''
      subscription_value_17: ''
      subscription_value_18: ''
      subscription_value_19: ''
      subscription_value_2: ''
      subscription_value_20: ''
      subscription_value_21: ''
      subscription_value_22: ''
      subscription_value_23: ''
      subscription_value_24: ''
      subscription_value_25: ''
      subscription_value_26: ''
      subscription_value_27: ''
      subscription_value_28: ''
      subscription_value_29: ''
      subscription_value_3: ''
      subscription_value_30: ''
      subscription_value_31: ''
      subscription_value_32: ''
      subscription_value_33: ''
      subscription_value_34: ''
      subscription_value_35: ''
      subscription_value_36: ''
      subscription_value_37: ''
      subscription_value_38: ''
      subscription_value_39: ''
      subscription_value_4: ''
      subscription_value_40: ''
      subscription_value_41: ''
      subscription_value_42: ''
      subscription_value_43: ''
      subscription_value_44: ''
      subscription_value_45: ''
      subscription_value_46: ''
      subscription_value_47: ''
      subscription_value_48: ''
      subscription_value_49: ''
      subscription_value_5: ''
      subscription_value_50: ''
      subscription_value_51: ''
      subscription_value_52: ''
      subscription_value_53: ''
      subscription_value_54: ''
      subscription_value_55: ''
      subscription_value_56: ''
      subscription_value_57: ''
      subscription_value_58: ''
      subscription_value_59: ''
      subscription_value_6: ''
      subscription_value_60: ''
      subscription_value_61: ''
      subscription_value_62: ''
      subscription_value_63: ''
      subscription_value_64: ''
      subscription_value_65: ''
      subscription_value_66: ''
      subscription_value_67: ''
      subscription_value_68: ''
      subscription_value_69: ''
      subscription_value_7: ''
      subscription_value_70: ''
      subscription_value_71: ''
      subscription_value_72: ''
      subscription_value_73: ''
      subscription_value_74: ''
      subscription_value_75: ''
      subscription_value_76: ''
      subscription_value_77: ''
      subscription_value_78: ''
      subscription_value_79: ''
      subscription_value_8: ''
      subscription_value_80: ''
      subscription_value_81: ''
      subscription_value_82: ''
      subscription_value_83: ''
      subscription_value_84: ''
      subscription_value_85: ''
      subscription_value_86: ''
      subscription_value_87: ''
      subscription_value_88: ''
      subscription_value_89: ''
      subscription_value_9: ''
      subscription_value_90: ''
      subscription_value_91: ''
      subscription_value_92: ''
      subscription_value_93: ''
      subscription_value_94: ''
      subscription_value_95: ''
      subscription_value_96: ''
      subscription_value_97: ''
      subscription_value_98: ''
      subscription_value_99: ''
      thumbnail_file_name: '{episode_file_path}-thumb.jpg'
      tv_show_content_rating: '{subscription_indent_2}'
      tv_show_content_rating_default: TV-14
      tv_show_directory: /tv_shows
      tv_show_fanart_file_name: fanart.jpg
      tv_show_genre: '{subscription_indent_1}'
      tv_show_genre_default: ytdl-sub
      tv_show_name: Curiosity Stream
      tv_show_poster_file_name: poster.jpg
      url: https://curiositystream.com/collections/13
      url10: '{subscription_value_10}'
      url100: '{subscription_value_100}'
      url11: '{subscription_value_11}'
      url12: '{subscription_value_12}'
      url13: '{subscription_value_13}'
      url14: '{subscription_value_14}'
      url15: '{subscription_value_15}'
      url16: '{subscription_value_16}'
      url17: '{subscription_value_17}'
      url18: '{subscription_value_18}'
      url19: '{subscription_value_19}'
      url2: '{subscription_value_2}'
      url20: '{subscription_value_20}'
      url21: '{subscription_value_21}'
      url22: '{subscription_value_22}'
      url23: '{subscription_value_23}'
      url24: '{subscription_value_24}'
      url25: '{subscription_value_25}'
      url26: '{subscription_value_26}'
      url27: '{subscription_value_27}'
      url28: '{subscription_value_28}'
      url29: '{subscription_value_29}'
      url3: '{subscription_value_3}'
      url30: '{subscription_value_30}'
      url31: '{subscription_value_31}'
      url32: '{subscription_value_32}'
      url33: '{subscription_value_33}'
      url34: '{subscription_value_34}'
      url35: '{subscription_value_35}'
      url36: '{subscription_value_36}'
      url37: '{subscription_value_37}'
      url38: '{subscription_value_38}'
      url39: '{subscription_value_39}'
      url4: '{subscription_value_4}'
      url40: '{subscription_value_40}'
      url41: '{subscription_value_41}'
      url42: '{subscription_value_42}'
      url43: '{subscription_value_43}'
      url44: '{subscription_value_44}'
      url45: '{subscription_value_45}'
      url46: '{subscription_value_46}'
      url47: '{subscription_value_47}'
      url48: '{subscription_value_48}'
      url49: '{subscription_value_49}'
      url5: '{subscription_value_5}'
      url50: '{subscription_value_50}'
      url51: '{subscription_value_51}'
      url52: '{subscription_value_52}'
      url53: '{subscription_value_53}'
      url54: '{subscription_value_54}'
      url55: '{subscription_value_55}'
      url56: '{subscription_value_56}'
      url57: '{subscription_value_57}'
      url58: '{subscription_value_58}'
      url59: '{subscription_value_59}'
      url6: '{subscription_value_6}'
      url60: '{subscription_value_60}'
      url61: '{subscription_value_61}'
      url62: '{subscription_value_62}'
      url63: '{subscription_value_63}'
      url64: '{subscription_value_64}'
      url65: '{subscription_value_65}'
      url66: '{subscription_value_66}'
      url67: '{subscription_value_67}'
      url68: '{subscription_value_68}'
      url69: '{subscription_value_69}'
      url7: '{subscription_value_7}'
      url70: '{subscription_value_70}'
      url71: '{subscription_value_71}'
      url72: '{subscription_value_72}'
      url73: '{subscription_value_73}'
      url74: '{subscription_value_74}'
      url75: '{subscription_value_75}'
      url76: '{subscription_value_76}'
      url77: '{subscription_value_77}'
      url78: '{subscription_value_78}'
      url79: '{subscription_value_79}'
      url8: '{subscription_value_8}'
      url80: '{subscription_value_80}'
      url81: '{subscription_value_81}'
      url82: '{subscription_value_82}'
      url83: '{subscription_value_83}'
      url84: '{subscription_value_84}'
      url85: '{subscription_value_85}'
      url86: '{subscription_value_86}'
      url87: '{subscription_value_87}'
      url88: '{subscription_value_88}'
      url89: '{subscription_value_89}'
      url9: '{subscription_value_9}'
      url90: '{subscription_value_90}'
      url91: '{subscription_value_91}'
      url92: '{subscription_value_92}'
      url93: '{subscription_value_93}'
      url94: '{subscription_value_94}'
      url95: '{subscription_value_95}'
      url96: '{subscription_value_96}'
      url97: '{subscription_value_97}'
      url98: '{subscription_value_98}'
      url99: '{subscription_value_99}'
    preset:
    - _jellyfin_tv_show
    - _tv_show_by_date
    - _season_by_year
    - jellyfin_tv_show_by_date
    - season_by_year__episode_by_month_day_reversed
    - add_subtitles
    - sponsorblock
    - include_info_json
    - curiositystream
    subtitles:
      allow_auto_generated_subtitles: true
      embed_subtitles: true
      languages: en
    throttle_protection:
      sleep_per_download_s:
        max: 353.2
        min: 30.8
      sleep_per_subscription_s:
        max: 245.1
        min: 25.3
    video_tags:
      contentRating: '{episode_content_rating}'
      date: '{episode_date_standardized}'
      episode_id: '{episode_number}'
      genre: '{tv_show_genre}'
      show: '{tv_show_name}'
      synopsis: '{episode_plot}'
      title: '{episode_title}'
      year: '{episode_year}'
    ytdl_options:
      break_on_existing: true
      cookiefile: /config/cookies.txt
      cookies: /config/cookies.txt
      format: bestvideo+bestaudio/mp4
      nocheckcertificate: null
      noplaylist: null
      password: *****
      sleep_interval_requests: 30
      username: nathan91hunt@gmail.com

[ytdl-sub:ytdl-options] Setting match-filters: 
 - !is_live & !is_upcoming & !post_live & upload_date < 20240412
[ytdl-sub:ytdl-options] Setting breaking-match-filters: []
[ytdl-sub:yt-dlp-downloader] ytdl_options: {'ignoreerrors': True, 'outtmpl': '.ytdl-sub-downloads/CuriosityStream4k/%(id)S.%(ext)s', 'writethumbnail': False, 'ffmpeg_location': '/usr/bin/ffmpeg', 'download_archive': '.ytdl-sub-downloads/CuriosityStream4k/.ytdl-sub-CuriosityStream4k-download-archive.json', 'match_filter': yt_dlp.utils.match_filter_func(['!is_live & !is_upcoming & !post_live & upload_date < 20240412'], []), 'break_on_existing': True, 'format': 'bestvideo+bestaudio/mp4', 'cookies': '/config/cookies.txt', 'sleep_interval_requests': 30, 'username': 'nathan91hunt@gmail.com', 'password': '*****', 'noplaylist': None, 'nocheckcertificate': None, 'cookiefile': '/config/cookies.txt', 'skip_download': True, 'writeinfojson': True, 'extract_flat': 'discard'}
[ytdl-sub:yt-dlp] [curiositystream:collections] Logging in
[ytdl-sub:yt-dlp] [curiositystream:collections] Extracting URL: https://curiositystream.com/collections/13
[ytdl-sub:yt-dlp] [curiositystream:collections] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream:collections] 13: Downloading JSON metadata
[ytdl-sub:yt-dlp] [download] Downloading playlist: The World In 4K
[ytdl-sub:yt-dlp] [info] Writing playlist metadata as JSON to: .ytdl-sub-downloads/CuriosityStream4k/13.info.json
[ytdl-sub:yt-dlp] [curiositystream:collections] Playlist The World In 4K: Downloading 50 items of 50
[ytdl-sub:yt-dlp] [download] Downloading item 1 of 50
[ytdl-sub:yt-dlp] [curiositystream:series] Sleeping 30 seconds ...
[ytdl-sub:downloader] Downloading metadata for The World In 4K
[ytdl-sub:yt-dlp] [curiositystream:series] Logging in
[ytdl-sub:yt-dlp] [curiositystream:series] Extracting URL: https://curiositystream.com/series/570
[ytdl-sub:yt-dlp] [curiositystream:series] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream:series] 570: Downloading JSON metadata
[ytdl-sub:yt-dlp] [download] Downloading playlist: The Humboldt Current
[ytdl-sub:yt-dlp] [info] Writing playlist metadata as JSON to: .ytdl-sub-downloads/CuriosityStream4k/570.info.json
[ytdl-sub:yt-dlp] [curiositystream:series] Playlist The Humboldt Current: Downloading 3 items of 3
[ytdl-sub:yt-dlp] [download] Downloading item 1 of 3
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:downloader] Downloading metadata for The Humboldt Current
[ytdl-sub:yt-dlp] [curiositystream] Logging in
[ytdl-sub:yt-dlp] [curiositystream] Extracting URL: https://curiositystream.com/video/4212
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4212: Downloading JSON metadata
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4212: Downloading m3u8 information
[ytdl-sub:yt-dlp] WARNING: [curiositystream] Ignoring subtitle tracks found in the HLS manifest; if any subtitle tracks are missing, please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4212: Downloading JSON metadata
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4212: Downloading MPD manifest
[ytdl-sub:yt-dlp] WARNING: [curiositystream] Ignoring subtitle tracks found in the DASH manifest; if any subtitle tracks are missing, please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
[ytdl-sub:yt-dlp] [download] Genesis does not pass filter (!is_live & !is_upcoming & !post_live & upload_date < 20240412), skipping ..
[ytdl-sub:yt-dlp] [download] Downloading item 2 of 3
[ytdl-sub:yt-dlp] [curiositystream] Extracting URL: https://curiositystream.com/video/4213
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4213: Downloading JSON metadata
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4213: Downloading m3u8 information
[ytdl-sub:yt-dlp] WARNING: [curiositystream] Ignoring subtitle tracks found in the HLS manifest; if any subtitle tracks are missing, please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4213: Downloading JSON metadata
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4213: Downloading MPD manifest
[ytdl-sub:yt-dlp] WARNING: [curiositystream] Ignoring subtitle tracks found in the DASH manifest; if any subtitle tracks are missing, please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
[ytdl-sub:yt-dlp] [download] Renewal does not pass filter (!is_live & !is_upcoming & !post_live & upload_date < 20240412), skipping ..
[ytdl-sub:yt-dlp] [download] Downloading item 3 of 3
[ytdl-sub:yt-dlp] [curiositystream] Extracting URL: https://curiositystream.com/video/4214
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4214: Downloading JSON metadata
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4214: Downloading m3u8 information
[ytdl-sub:yt-dlp] WARNING: [curiositystream] Ignoring subtitle tracks found in the HLS manifest; if any subtitle tracks are missing, please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4214: Downloading JSON metadata
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream] 4214: Downloading MPD manifest
[ytdl-sub:yt-dlp] WARNING: [curiositystream] Ignoring subtitle tracks found in the DASH manifest; if any subtitle tracks are missing, please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
[ytdl-sub:yt-dlp] [download] Arrival does not pass filter (!is_live & !is_upcoming & !post_live & upload_date < 20240412), skipping ..
[ytdl-sub:yt-dlp] [info] Writing updated playlist metadata as JSON to: .ytdl-sub-downloads/CuriosityStream4k/570.info.json
[ytdl-sub:yt-dlp] [download] Finished downloading playlist: The Humboldt Current
[ytdl-sub:yt-dlp] [download] Downloading item 2 of 50
[ytdl-sub:yt-dlp] [curiositystream:series] Extracting URL: https://curiositystream.com/series/359
[ytdl-sub:yt-dlp] [curiositystream:series] Sleeping 30 seconds ...
[ytdl-sub:yt-dlp] [curiositystream:series] 359: Downloading JSON metadata
[ytdl-sub:yt-dlp] [download] Downloading playlist: Wild Chile
[ytdl-sub:yt-dlp] [info] Writing playlist metadata as JSON to: .ytdl-sub-downloads/CuriosityStream4k/359.info.json
[ytdl-sub:yt-dlp] [curiositystream:series] Playlist Wild Chile: Downloading 3 items of 3
[ytdl-sub:yt-dlp] [download] Downloading item 1 of 3
[ytdl-sub:yt-dlp] [curiositystream] Extracting URL: https://curiositystream.com/video/2081
[ytdl-sub:yt-dlp] [curiositystream] Sleeping 30 seconds ...
[ytdl-sub:downloader] Downloading metadata for Wild Chile
dfein38347g commented 2 months ago

@jmbannon Do you know how I could remove or bypass the default match filters?

[ytdl-sub:yt-dlp] [download] Arrival does not pass filter (!is_live & !is_upcoming & !post_live & upload_date < 20240412), skipping ..

dfein38347g commented 2 months ago

@jmbannon It looks like the issue stems from https://github.com/jmbannon/ytdl-sub/commit/6615e1d1ac0279c40f365e5805d7ef132a9e2516. There is a reference to docs about download_match_filters https://github.com/jmbannon/ytdl-sub/releases/tag/2023.09.24.post1. However it appears that filter is no longer there in the docs or in the code. I tried rolling back to that release using docker but there are too many differences and it won't download my subscriptions. Can you help identify a way to override the default match filters?

jmbannon commented 2 months ago

@dfein38347g it's not possible at the moment. Do you know which match-filter is tripping your video? I'd prefer ytdl-sub to not deal with live vids, but perhaps its best to let the user make that decision

dfein38347g commented 2 months ago

@dfein38347g it's not possible at the moment. Do you know which match-filter is tripping your video? I'd prefer ytdl-sub to not deal with live vids, but perhaps its best to let the user make that decision

@jmbannon Unfortunately I do not. The videos have been trying to download for a few weeks. I'm assuming the curiosity stream videos are missing one or more of those categories and tripping up the filter.

Is it possible to have a setting in the plugin that would remove the default filters if desired?

dfein38347g commented 1 month ago

@jmbannon I'm wondering if it's possible to have a setting in the plugin that would remove the default filters if desired?