Unable to extract categories

arthur-trt commented 10 years ago

When I want to download a video with this command : youtube-dl -i --no-check-certificate --output "%(title)s.%(ext)s" -u "************" -p "********" --no- playlist --buffer-size 64M --write-thumbnail --format "bestaudio" -x --audio-format "mp3" --audio-quality 0 https://www.youtube.com/watch?v=jj-5E0-q--o I've this in the return :

[youtube] Setting language
[youtube] Downloading login page
[youtube] Logging in
[youtube] Confirming age
[youtube] jj-5E0-q--o: Downloading webpage
[youtube] jj-5E0-q--o: Downloading video info webpage
[youtube] jj-5E0-q--o: Extracting video information
WARNING: unable to extract categories; please report this issue on http://yt-dl.org/bug
[youtube] jj-5E0-q--o: Downloading thumbnail ...
[youtube] jj-5E0-q--o: Writing thumbnail to: Test du recul et Trisomique 21.2.jpg
[download] Destination: Test du recul et Trisomique 21.2.m4a
[download] 100% of 7.43MiB in 00:00
ERROR: WARNING: unable to obtain file audio codec with ffprobe

Can you fix it or help me please ? :)

Thanks !

phihag commented 10 years ago

Can you post the output you get when you add -v --dump-intermediate-pages to the command line (warning: Will be big, redirect with >file.log 2>&1)? That should help us to find out why the category extraction failed.

Note that that is only a warning though. The problem is different: Do you have ffprobe installed on your system? What is the output of ffprobe -version? To give more specific instructions, we'll need the aforementioned output of youtube-dl.

arthur-trt commented 10 years ago

This is the return of the command : http://pastebin.com/kPNbXRqz

And here the return of ffprobe -version :

ffprobe version 1.0.10
built on Jul 25 2014 07:50:40 with gcc 4.7 (Debian 4.7.2-5)
configuration: --prefix=/usr --extra-cflags='-g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security ' --extra-ldflags='-Wl,-z,relro' --cc='ccache cc' --enable-shared --enable-libmp3lame --enable-gpl --enable-nonfree --enable-libvorbis --enable-pthreads --enable-libfaac --enable-libxvid --enable-postproc --enable-x11grab --enable-libgsm --enable-libtheora --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libx264 --enable-libspeex
 --enable-nonfree --disable-stripping --enable-libvpx --enable-libschroedinger --disable-encoder=libschroedinger --enable-version3 --enable-libopenjpeg --enable-librtmp --enable-avfilter --enable-libfreetype --enable-libvo-aacenc --disable-decoder=amrnb --enable-libvo-amrwbenc --enable-libaacplus --libdir=/usr/lib/x86_64-linux-gnu --disable-vda --enable-libbluray --enable-libcdio --enable-gnutls --enable-frei0r --enable-openssl --enable-libass --enable-libopus --enable-fontconfig --enable-libfdk-aac --enable-libdc1394 --disable-altivec --disable-armv5te --disable-armv6 --disable-vis --shlibdir=/usr/lib/x86_64-linux-gnu
libavutil      51. 73.101 / 51. 73.101
libavcodec     54. 59.100 / 54. 92.100
libavformat    54. 29.104 / 54. 63.104
libavdevice    54.  2.101 / 54.  2.101
libavfilter     3. 17.100 /  3. 17.100
libswscale      2.  1.101 /  2.  2.100
libswresample   0. 15.100 /  0. 17.102
libpostproc    52.  0.100 / 52.  2.100

I'm on Debian Wheezy ;-)

phihag commented 10 years ago

Mmm, that output is really, really strange. It should be a lot longer. The base64-decoded strings should be the entire code served by YouTube, but it's only the first bytes and then base64: invalid input after that.

Also, the line breaks look broken.

The ffprobe looks nowhere near that what you get when you run sudo apt-get install -y ffmpeg on a current wheezy, since that would install avutils.

On a brand-new wheezy on AWS (debian-7-amd64-default 1403184978 to be exact), the whole download works fine, and I get none of the warnings or problems.

We will need to look in depth of what is happening here, and for that it's essential to be able to reproduce this issue. Can you do one of the following?

Check whether username and password are causing this problem. If you remove -u and -p, does the problem persist?
Test with another ISP, preferable from another country (contact me in private if you don't have access to other ISPs)
Reproduce the problem with another machine (wheezy is fine)
Give me access to an identical test machine that shows the problem
Give us the files you get when running with --write-pages.

arthur-trt commented 10 years ago

This is the output of sudo apt-get install -y ffmpeg :

Reading package lists... Done
Building dependency tree
Reading state information... Done
ffmpeg is already the newest version.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

But after some test, I use Avconv and my video is convert in MP3 without any problem, but when I put my user account, I've this warning : WARNING: unable to extract categories; please report this issue on http://yt-dl.org/bug and no problem if I remove my user account !

Command with -v --dump-intermediate-page --write-page and with -u and -p :

[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-i', '--no-check-certificate', '--output', '%(title)s.%(ext)s', '-u', u'<PRIVATE>', '-p', u'<PRIVATE>', '--no-playlist', '--buff$[debug] Encodings: locale UTF-8, fs UTF-8, out None, pref UTF-8
[debug] youtube-dl version 2014.09.24.1
[debug] Python version 2.7.3 - Linux-3.2.14-std-ipv6-64-x86_64-with-debian-7.6
[debug] Proxy map: {}
[youtube] Setting language
[youtube] Dumping request to https://www.youtube.com/?hl=en&persist_hl=1&gl=US&persist_gl=1&opt_out_ackd=1
ICA8IURPQ1RZUEUgaHRtbD48aHRtbCBsYW5nPSJlbiIgZGF0YS1jYXN0LWFwaS1lbmFibGVkPSJ0cnVlIj48aGVhZD48c2NyaXB0PnZhciB5dGNzaSA9IHtndDogZnVuY3Rpb24obikge24gPSAobiB8fCAnJ$[youtube] Saving request to None_https_-_www.youtube.com_hl=en_persist_hl=1_gl=US_persist_gl=1_opt_out_ackd=1.dump
[youtube] Downloading login page
[youtube] Dumping request to https://accounts.google.com/ServiceLogin
CjwhRE9DVFlQRSBodG1sPgo8aHRtbCBsYW5nPSJlbiI+CiAgPGhlYWQ+CiAgPG1ldGEgY2hhcnNldD0idXRmLTgiPgogIDxtZXRhIGNvbnRlbnQ9IndpZHRoPTMwMCwgaW5pdGlhbC1zY2FsZT0xIiBuYW1lP$[youtube] Saving request to None_https_-_accounts.google.com_ServiceLogin.dump
[youtube] Logging in
[youtube] Dumping request to https://accounts.google.com/ServiceLogin
ICA8IURPQ1RZUEUgaHRtbD48aHRtbCBsYW5nPSJmciIgZGF0YS1jYXN0LWFwaS1lbmFibGVkPSJ0cnVlIj48aGVhZD48c2NyaXB0PnZhciB5dGNzaSA9IHtndDogZnVuY3Rpb24obikge24gPSAobiB8fCAnJ$[youtube] Saving request to None_https_-_accounts.google.com_ServiceLogin.dump
[youtube] Confirming age
[youtube] Dumping request to https://www.youtube.com/verify_age?next_url=/&gl=US&hl=en
CjwhRE9DVFlQRSBodG1sPgogIDxodG1sIGxhbmc9ImZyIiBkaXI9Imx0ciIgPgoKPGhlYWQ+CiAgPHNjcmlwdD52YXIgeXRjc2kgPSB7Z3Q6IGZ1bmN0aW9uKG4pIHtuID0gKG4gfHwgJycpICsgJ2RhdGFfJ$[youtube] Saving request to None_https_-_www.youtube.com_verify_agenext_url=_gl=US_hl=en.dump
[youtube] jj-5E0-q--o: Downloading webpage
[youtube] Dumping request to https://www.youtube.com/watch?v=jj-5E0-q--o&gl=US&hl=en&has_verified=1
PCFET0NUWVBFIGh0bWw+PGh0bWwgbGFuZz0iZnIiIGRhdGEtY2FzdC1hcGktZW5hYmxlZD0idHJ1ZSI+PGhlYWQ+PHNjcmlwdD52YXIgeXRjc2kgPSB7Z3Q6IGZ1bmN0aW9uKG4pIHtuID0gKG4gfHwgJycpI$[youtube] Saving request to jj-5E0-q--o_https_-_www.youtube.com_watchv=jj-5E0-q--o_gl=US_hl=en_has_verified=1.dump
[youtube] jj-5E0-q--o: Downloading video info webpage
[youtube] Dumping request to https://www.youtube.com/get_video_info?&video_id=jj-5E0-q--o&el=embedded&ps=default&eurl=&gl=US&hl=en
c3VidGl0bGVzX3hsYj1odHRwcyUzQSUyRiUyRnMueXRpbWcuY29tJTJGeXRzJTJGeGxiYmluJTJGc3VidGl0bGVzLXN0cmluZ3MtZnJfRlItdmZsN0t4Q2N1LnhsYiZoYXNfY2M9VHJ1ZSZob3N0X2xhbmd1Y$[youtube] Saving request to jj-5E0-q--o_https_-_www.youtube.com_get_video_info_video_id=jj-5E0-q--o_el=embedded_ps=default_eurl=_gl=US_hl=en.dump
[youtube] jj-5E0-q--o: Extracting video information
WARNING: unable to extract categories; please report this issue on http://yt-dl.org/bug
[youtube] jj-5E0-q--o: Downloading thumbnail ...
[youtube] jj-5E0-q--o: Writing thumbnail to: Test du recul et Trisomique 21.2.jpg
[debug] Invoking downloader on u'https://r15---sn-25ge7n7l.googlevideo.com/videoplayback?clen=7790078&mt=1411905676&itag=140&upn=Tgd49W3ds2o&fexp=908579%2C91$[download] Destination: Test du recul et Trisomique 21.2.m4a
^M[download] 100.0% of 7.43MiB at 15.96MiB/s ETA 00:00^M[download] 100% of 7.43MiB in 00:00
[avconv] Destination: Test du recul et Trisomique 21.2.mp3
[debug] ffmpeg command line: avconv -y -i 'Test du recul et Trisomique 21.2.m4a' -vn -acodec libmp3lame -q:a 0 'Test du recul et Trisomique 21.2.mp3'
Deleting original file Test du recul et Trisomique 21.2.m4a (pass -k to keep)

And the same commande without -u and -p :

[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-i', '--no-check-certificate', '--output', '%(title)s.%(ext)s', '--no-playlist', '--buffer-size', '64M', '--write-thumbnail', '-$[debug] Encodings: locale UTF-8, fs UTF-8, out None, pref UTF-8
[debug] youtube-dl version 2014.09.24.1
[debug] Python version 2.7.3 - Linux-3.2.14-std-ipv6-64-x86_64-with-debian-7.6
[debug] Proxy map: {}
[youtube] Setting language
[youtube] Dumping request to https://www.youtube.com/?hl=en&persist_hl=1&gl=US&persist_gl=1&opt_out_ackd=1
ICA8IURPQ1RZUEUgaHRtbD48aHRtbCBsYW5nPSJlbiIgZGF0YS1jYXN0LWFwaS1lbmFibGVkPSJ0cnVlIj48aGVhZD48c2NyaXB0PnZhciB5dGNzaSA9IHtndDogZnVuY3Rpb24obikge24gPSAobiB8fCAnJ$[youtube] Saving request to None_https_-_www.youtube.com_hl=en_persist_hl=1_gl=US_persist_gl=1_opt_out_ackd=1.dump
[youtube] Confirming age
[youtube] Dumping request to https://www.youtube.com/verify_age?next_url=/&gl=US&hl=en
CjwhRE9DVFlQRSBodG1sPgogIDxodG1sIGxhbmc9ImVuIiBkaXI9Imx0ciIgPgoKPGhlYWQ+CiAgPHNjcmlwdD52YXIgeXRjc2kgPSB7Z3Q6IGZ1bmN0aW9uKG4pIHtuID0gKG4gfHwgJycpICsgJ2RhdGFfJ$[youtube] Saving request to None_https_-_www.youtube.com_verify_agenext_url=_gl=US_hl=en.dump
[youtube] jj-5E0-q--o: Downloading webpage
[youtube] Dumping request to https://www.youtube.com/watch?v=jj-5E0-q--o&gl=US&hl=en&has_verified=1
PCFET0NUWVBFIGh0bWw+PGh0bWwgbGFuZz0iZW4iIGRhdGEtY2FzdC1hcGktZW5hYmxlZD0idHJ1ZSI+PGhlYWQ+PHNjcmlwdD52YXIgeXRjc2kgPSB7Z3Q6IGZ1bmN0aW9uKG4pIHtuID0gKG4gfHwgJycpI$[youtube] Saving request to jj-5E0-q--o_https_-_www.youtube.com_watchv=jj-5E0-q--o_gl=US_hl=en_has_verified=1.dump
[youtube] jj-5E0-q--o: Downloading video info webpage
[youtube] Dumping request to https://www.youtube.com/get_video_info?&video_id=jj-5E0-q--o&el=embedded&ps=default&eurl=&gl=US&hl=en
cHRrPW1lbGJlcnJpZXNfbWFuYWdlZCZhdGM9YSUzRDMlMjZiJTNEOXh3TG5zLTBMNWpWMFhET3NsQnFFaEFVSUE0JTI2YyUzRDE0MTE5MDU4OTIlMjZkJTNEMSUyNmUlM0Rqai01RTAtcS0tbyUyNmMzYSUzR$[youtube] Saving request to jj-5E0-q--o_https_-_www.youtube.com_get_video_info_video_id=jj-5E0-q--o_el=embedded_ps=default_eurl=_gl=US_hl=en.dump
[youtube] jj-5E0-q--o: Extracting video information
[youtube] jj-5E0-q--o: Downloading thumbnail ...
[youtube] jj-5E0-q--o: Writing thumbnail to: Test du recul et Trisomique 21.2.jpg
[debug] Invoking downloader on u'https://r15---sn-25ge7n7l.googlevideo.com/videoplayback?gir=yes&requiressl=yes&sver=3&key=yt5&expire=1411927492&lmt=13985555$[download] Destination: Test du recul et Trisomique 21.2.m4a
^M[download] 100.0% of 7.43MiB at 15.96MiB/s ETA 00:00^M[download] 100% of 7.43MiB in 00:00
[avconv] Destination: Test du recul et Trisomique 21.2.mp3
[debug] ffmpeg command line: avconv -y -i 'Test du recul et Trisomique 21.2.m4a' -vn -acodec libmp3lame -q:a 0 'Test du recul et Trisomique 21.2.mp3'
Deleting original file Test du recul et Trisomique 21.2.m4a (pass -k to keep)

Thank you for your help !

phihag commented 10 years ago

Thank you for the report. I believe this bug to be fixed in youtube-dl 2014.09.29.1. Type sudo youtube-dl -U to update.

ytdl-org / youtube-dl

Unable to extract categories #3824