Unable to download JSON metadata

ghost commented 6 years ago

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run `youtube-dl --version` and ensure your version is 2018.08.04. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[ x] I've verified and I assure that I'm running youtube-dl 2018.08.04

Before submitting an issue make sure you have:

[ x] At least skimmed through the README, most notably the FAQ and BUGS sections
[ x] Searched the bugtracker for similar issues including closed ones
[x ] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

[debug] System config: [] [debug] User config: [] [debug] Custom config: [] [debug] Command-line args: ['--proxy', 'socks5://127.0.0.1:1080/', '--user-agent', 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.106 Safari/537.36', '--verbose', '-c', '--skip-unavailable-fragments', '--no-check-certificate', 'https://www.youtube.com/playlist?list=PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh', '--playlist-start', '2731', '--playlist-end', '2800', '-o', '%(playlist_index).%(title)s.%(ext)s'] [debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8 [debug] youtube-dl version 2018.08.04 [debug] Python version 3.6.6 (CPython) - Linux-4.14.60-1-MANJARO-x86_64-with-arch-Manjaro-Linux [debug] exe versions: ffmpeg n4.0.2, ffprobe n4.0.2, rtmpdump 2.4 [debug] Proxy map: {'http': 'socks5://127.0.0.1:1080/', 'https': 'socks5://127.0.0.1:1080/'} [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading webpage [download] Downloading playlist: YY LIVE 燃舞蹈（Artist・Sing・Music・Dance・Instrument・Talent Shows・DJ・KPOP・Remix・LIVE) [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #1 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #2 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #3 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #4 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #5 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #6 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #7 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #8 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #9 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #10 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #11 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #12 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #13 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #14 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #15 [youtube:playlist] PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh: Downloading page #16 ERROR: Unable to download JSON metadata: <urlopen error [Errno 0] Error> (caused by URLError(OSError(0, 'Error'),)) File "/usr/lib/python3.6/site-packages/youtube_dl/extractor/common.py", line 599, in _request_webpage return self._downloader.urlopen(url_or_request) File "/usr/lib/python3.6/site-packages/youtube_dl/YoutubeDL.py", line 2211, in urlopen return self._opener.open(req, timeout=self._socket_timeout) File "/usr/lib/python3.6/urllib/request.py", line 526, in open response = self._open(req, data) File "/usr/lib/python3.6/urllib/request.py", line 544, in _open '_open', req) File "/usr/lib/python3.6/urllib/request.py", line 504, in _call_chain result = func(*args) File "/usr/lib/python3.6/site-packages/youtube_dl/utils.py", line 1102, in https_open req, **kwargs) File "/usr/lib/python3.6/urllib/request.py", line 1320, in do_open raise URLError(err)

Playlist: https://www.youtube.com/playlist?list=PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh It's not my playlist . I do not know why someone add so much videos to a single list .

Description of your issue, suggested solution and other information

command line like this ,

youtube-dl --proxy socks5://127.0.0.1:1080/ \ --user-agent "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.106 Safari/537.36" \ --verbose -c --skip-unavailable-fragments --no-check-certificate \ "https://www.youtube.com/playlist?list=PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh" \ --playlist-start 2731 --playlist-end 2800 \ -o "%(playlist_index).%(title)s.%(ext)s"

I hope i did not use it wrong .Is it a network issue or just the playlist too big ?

dstftw commented 6 years ago

Most likey caused by your proxy.

ghost commented 6 years ago

Other tools with my proxy works fine .

ghost commented 6 years ago

Does youtube-dl need credentials from my google Data API ? client_secret.json , is it the file .

ghost commented 6 years ago

@dstftw It's buffer related ,i think.

I add --http-chunk-size 1M --buffer-size 10M --no-resize-buffer min-sleep-interal 5 --max-sleep-interval 10 . and it works fine. This is the playlist in question

"https://www.youtube.com/playlist?list=PLy6FxrdZ3VARMcFJobwdA0nsIs2DmtrVh"

It's a big playlist , has 1000+ videos . maybe you can test ,which parameter works .

--With best wish .

dstftw commented 6 years ago

These options have nothing to do with your issue. As already said it most likely that your proxy fails from time to time.

ytdl-org / youtube-dl