Site support request: cafe.naver.com

[git-test02]

Checklist

• [x] I'm reporting a new site support request
• [x] I've verified that I'm running youtube-dl version 2021.06.06
• [x] I've checked that all provided URLs are alive and playable in a browser
• [x] I've checked that none of provided URLs violate any copyrights
• [x] I've searched the bugtracker for similar site support requests including closed ones

Example URLs

• Single video: https://cafe.naver.com/fakesoul/105792

Description

WRITE DESCRIPTION HERE [debug] Command-line args: ['-f', 'https://cafe.naver.com/fakesoul/105792'] [debug] Encodings: locale cp932, fs mbcs, out cp932, pref cp932 [debug] youtube-dl version 2021.06.06 [debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19043 [debug] exe versions: ffmpeg 2021-06-09-git-e01bf559df-full_build-www.gyan.dev, ffprobe 2021-06-09-git-e01bf559df-full_build-www.gyan.dev Unsupported URL: https://cafe.naver.com/fakesoul/105792

[wajhk]

• [im aziz ali ]()

[wajhk]

Welcome My brother

[SuperSonicHub1]

@git-test02 Do you have more example URLs?

[SuperSonicHub1]

How to Crack Naver Cafe

Terminology

Naver Cafe seems to be a collection of forums called "cafes", a la Reddit and its "subreddits". Cafes are referred to internally as "clubs". Posts are referred to as "articles".

Parse article ID and club ID

https://cafe.naver.com/fakesoul/105792
https://cafe.naver.com/<cafe>/<id>
== OR ==
https://cafe.naver.com/fakesoul?iframe_url_utf8=/ArticleRead.nhn%3Farticleid=105792%26clubid=25227043
https://cafe.naver.com/<cafe>?iframe_url_utf8=/ArticleRead.nhn%3Farticleid=<id>%26clubid=<clubid>
== OR ==
https://cafe.naver.com/ca-fe/ArticleRead.nhn?articleid=105792&clubid=25227043
https://cafe.naver.com/ca-fe/ArticleRead.nhn?articleid=<id>&clubid=<clubid>

Get club ID if we don't already have it

If we aren't able to initially parse a club ID, we need to get it from the webpage given to youtube-dl. Luckily, the club ID is littered across the HTML, but this one example should suffice for now:

r"var g_sClubId = \"(.*)\";"

Get initial info about the article

• Download JSON from https://apis.naver.com/cafe-web/cafe-articleapi/v2/cafes/25227043/articles/105792
  • from now on we'll be referring to root['result'] as simply result
• before doing anything else, check to see that the article has a video
  • see if any of the elements in result['article']['contentElements'] has element['type'] == 'MOVIE'
• get youtube-dl metadata from result
  • "articleId"
  • "article"
  • "subject"
  • "writeDate"
  • "readCount"
  • "commentCount"
  • "writer"
    • "id"
    • "nick"
    • "image"
    • "url"
  • "comments"
  • "items" [array]
    • "id", "refId"
    • "writer" (same as above)
    • "content"
    • "updatedate"
• get the video IDs we need
  • for elements in result['article']['contentElements'] where element['type'] == 'MOVIE'
  • "json"
    • "vid"
    • "inKey"
    • "width" (more metadata)
    • "height" (more metadata)

      Get the media

• Download JSON from https://apis.naver.com/rmcnmv/rmcnmv/vod/play/v2.0/<vid>/?key=<inKey>
• Get HLS streams (source and individual resolutions) from root["streams"] [array]
  • could use some help with avoiding 403s, believe it has something to do with the keys array
• Get MP4s from root["videos"]["list"] [array]
  • "source" (URL)
  • "duration" (float)
  • "size" (bytes)
  • other encoding information as well
• Get thumbnails form root["thumbnails"]["list"] [array]
  • "source" (remove type=s80 to get full resolution)

Don't know if I'll implement the extractor myself, but I hope my research is of use to anyone that does.

[SuperSonicHub1]

@git-test02 Do you have more URLs with videos?