[lynda] Occasionally, yet consistently forgetting I wanted subtitles

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run `youtube-dl --version` and ensure your version is 2017.09.11. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2017.09.11

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--abort-on-error', u'--cookies', u'/home/bittaurus/lynda/cookies.txt', u'--all-subs', u'-o', u'~/lynda/%(playlist)s/%(chapter)s/%(playlist_index)s. %(title)s.%(ext)s', u'--playlist-start', u'84', u'--playlist-end', u'84', u'-v', u'--dump-json', u'https://www.lynda.com/Video-tutorials/Creating-lens-flares/129024/655896-4.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.09.11
[debug] Python version 2.7.13 - Linux-4.9.20-hardened-whatbox-r1-x86_64-Intel-R-_Pentium-R-_CPU_G850_@_2.90GHz-with-gentoo-2.3
[debug] exe versions: avconv 11.8, avprobe 11.8, ffmpeg 11.8, ffprobe 11.8, rtmpdump 2.4
[debug] Proxy map: {}
[debug] Default format spec: bestvideo+bestaudio/best
{"extractor": "lynda", "protocol": "https", "height": 720, "duration": 139, "fulltitle": "Creating lens flares", "id": "655896", "playlist": null, "title": "Creating lens flares", "_filename": "/home/bittaurus/lynda/NA/NA/NA. Creating lens flares.mp4", "playlist_index": null, "webpage_url_basename": "655896-4.html", "display_id": "655896", "format": "1-720 - 720p", "requested_subtitles": null, "format_id": "1-720", "subtitles": {}, "url": "https://lynda_files2-a.akamaihd.net/secure/courses/129024/VBR_MP4h264_main_HD720/129024_06_10_MM24_creating_flares.mp4?c3.ri=3770809745495994604&hashval=1505264119_70dcfced9c6b28a4193f253310ce26a3", "extractor_key": "Lynda", "http_headers": {"Accept-Charset": "ISO-8859-1,utf-8;q=0.7,*;q=0.7", "Accept-Language": "en-us,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)"}, "ext": "mp4", "webpage_url": "https://www.lynda.com/Video-tutorials/Creating-lens-flares/129024/655896-4.html", "formats": [{"protocol": "https", "format": "0-360 - 360p", "url": "https://files3.lynda.com/secure/courses/129024/iphone_MP4/129024_06_10_MM24_creating_flares.mp4?KgUAKF5cz6oGozewenoB7saupoUoIclc-wQ8VNmjMox3Rd2QbylWObja6rV7EX7EAq_BTaSo63IW5q1QIbVcKn2NhDdwwzQZJXFm4EbcrF2szjz8nidFJqv1_I5VUaSTdLfLNv1fppFK9OkpR4b3e0tzfCbPNmOAjVu5gGLOo_-McM-xltXeqsvuoA&c3.ri=3770809745495994604", "http_headers": {"Accept-Language": "en-us,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)", "Accept-Charset": "ISO-8859-1,utf-8;q=0.7,*;q=0.7", "Cookie": "cookies=*redacted*;}, "height": 360, "ext": "mp4", "format_id": "0-360"}, {"protocol": "https", "format": "1-360 - 360p", "url": "https://lynda_files2-a.akamaihd.net/secure/courses/129024/iphone_MP4/129024_06_10_MM24_creating_flares.mp4?c3.ri=3770809745495994604&hashval=1505264119_75d56681942ce9013de5b24db60ed050", "http_headers": {"Accept-Charset": "ISO-8859-1,utf-8;q=0.7,*;q=0.7", "Accept-Language": "en-us,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)"}, "height": 360, "ext": "mp4", "format_id": "1-360"}, {"protocol": "https", "format": "0-540 - 540p", "url": "https://files3.lynda.com/secure/courses/129024/VBR_MP4h264_main_SD/129024_06_10_MM24_creating_flares.mp4?gQSRoRc536V2QM53T_dVBAEBTB9-UgX_IGLLYeD73SHCyJu7x8-GsCwOwTcMAAX1x4FkzHZVYQUpbsj06W3_yExr9UlFsupJqXbk7EASa4N1iSl78dKx6RL02mZgF0hAkzj6BCNo6N93y-XdMdheqSIaqPelMGJZDLy_4kZtHfLx1xoD1PHRiTPu-EceBiVUS1x0iw&c3.ri=3770809745495994604", "http_headers": {"Accept-Language": "en-us,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)", "Accept-Charset": "ISO-8859-1,utf-8;q=0.7,*;q=0.7", "Cookie": *redacted*}, {"protocol": "https", "format": "1-540 - 540p", "url": "https://lynda_files2-a.akamaihd.net/secure/courses/129024/VBR_MP4h264_main_SD/129024_06_10_MM24_creating_flares.mp4?c3.ri=3770809745495994604&hashval=1505264119_288f479a7789ae98effd2c7503f8773e", "http_headers": {"Accept-Charset": "ISO-8859-1,utf-8;q=0.7,*;q=0.7", "Accept-Language": "en-us,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)"}, "height": 540, "ext": "mp4", "format_id": "1-540"}, {"protocol": "https", "format": "0-720 - 720p", "url": "https://files3.lynda.com/secure/courses/129024/VBR_MP4h264_main_HD720/129024_06_10_MM24_creating_flares.mp4?CI2hNKdS8QMF_Z_cSoACfam1fSLAx2KvoU1R3-pdC6TYwmMPcEP6zWxv-o4tRyNzY8-TvDEFmrXrmLtss5umassDrWxkOMgWguNnW_EJGQR-ilEv_T2Yf2PuoyWLFzwVFaFMtiChd9AOXP8zKCsk8yWhKJSJI9Y--NTBmRkOfeVRquMC-uxr0chcP5J2fUryK3y-uE96zw&c3.ri=3770809745495994604", "http_headers": {"Accept-Language": "en-us,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)", "Accept-Charset": "ISO-8859-1,utf-8;q=0.7,*;q=0.7", "Cookie": *redacted*}, "height": 720, "ext": "mp4", "format_id": "0-720"}, {"protocol": "https", "format": "1-720 - 720p", "url": "https://lynda_files2-a.akamaihd.net/secure/courses/129024/VBR_MP4h264_main_HD720/129024_06_10_MM24_creating_flares.mp4?c3.ri=3770809745495994604&hashval=1505264119_70dcfced9c6b28a4193f253310ce26a3", "http_headers": {"Accept-Charset": "ISO-8859-1,utf-8;q=0.7,*;q=0.7", "Accept-Language": "en-us,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/47.0 (Chrome)"}, "height": 720, "ext": "mp4", "format_id": "1-720"}]}

youtube-dl seems to be forgetting that I requested subtitles. His selective memory seems to manifest consistently within a given playlist. For instance, in this one it will not download .srt files for playlist items 45 or 84, even though they do exist, as I can view them with the videos through the web interface. I think perhaps the "requested_subtitles": null in the json output may give us a clue.

With --dump-json it won't download anything.

I added the --dump-json for your benifit. It doesn't download it with or without it. The bug is valid, as the json for items that it does download shows non-null "requested_subtitles".

You must provide verbose log that clearly demonstrates the issue. I'm not going to fortune tell where you've failed.

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--abort-on-error', u'--cookies', u'/home/bittaurus/lynda/cookies.txt', u'--all-subs', u'-o', u'~/lynda/%(playlist)s/%(chapter)s/%(playlist_index)s. %(title)s.%(ext)s', u'--playlist-start', u'84', u'--playlist-end', u'84', u'-vv', u'https://www.lynda.com/Video-tutorials/Creating-Short-Film-07-Cinematography/129024-2.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.09.11
[debug] Python version 2.7.13 - Linux-4.9.20-hardened-whatbox-r1-x86_64-Intel-R-_Pentium-R-_CPU_G850_@_2.90GHz-with-gentoo-2.3
[debug] exe versions: avconv 11.8, avprobe 11.8, ffmpeg 11.8, ffprobe 11.8, rtmpdump 2.4
[debug] Proxy map: {}
[lynda:course] 129024: Downloading course JSON
[download] Downloading playlist: Creating a Short Film: 07 Cinematography
[lynda:course] playlist Creating a Short Film: 07 Cinematography: Collected 98 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
[lynda] 655941: Downloading video JSON
[lynda] 655941: Checking 1-540 video format URL
[lynda] 655941: Checking 1-720 video format URL
[lynda] 655941: Checking 1-360 video format URL
[lynda] 655941: Checking 0-540 video format URL
[lynda] 655941: Checking 0-720 video format URL
[lynda] 655941: Checking 0-360 video format URL
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://lynda_files2-a.akamaihd.net/secure/courses/129024/VBR_MP4h264_main_HD720/129024_12_04_MM24_flagging.mp4?c3.ri=3774750402587458898&hashval=1505267358_3863004c8859ecf2c99823c15d652b75'
[download] /home/bittaurus/lynda/Creating a Short Film - 07 Cinematography/11. Fixing Mistakes/84. Flagging the light.mp4 has already been downloaded
[download] 100% of 7.22MiB
[download] Finished downloading playlist: Creating a Short Film: 07 Cinematography

And here is a verbose output from the previous item in the playlist, where it remembers to download the subtitles.

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--abort-on-error', u'--cookies', u'/home/bittaurus/lynda/cookies.txt', u'--all-subs', u'-o', u'~/lynda/%(playlist)s/%(chapter)s/%(playlist_index)s. %(title)s.%(ext)s', u'--playlist-start', u'83', u'--playlist-end', u'83', u'-vv', u'https://www.lynda.com/Video-tutorials/Creating-Short-Film-07-Cinematography/129024-2.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.09.11
[debug] Python version 2.7.13 - Linux-4.9.20-hardened-whatbox-r1-x86_64-Intel-R-_Pentium-R-_CPU_G850_@_2.90GHz-with-gentoo-2.3
[debug] exe versions: avconv 11.8, avprobe 11.8, ffmpeg 11.8, ffprobe 11.8, rtmpdump 2.4
[debug] Proxy map: {}
[lynda:course] 129024: Downloading course JSON
[download] Downloading playlist: Creating a Short Film: 07 Cinematography
[lynda:course] playlist Creating a Short Film: 07 Cinematography: Collected 98 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
[lynda] 655940: Downloading video JSON
[lynda] 655940: Checking 1-540 video format URL
[lynda] 655940: Checking 1-720 video format URL
[lynda] 655940: Checking 1-360 video format URL
[lynda] 655940: Checking 0-540 video format URL
[lynda] 655940: Checking 0-720 video format URL
[lynda] 655940: Checking 0-360 video format URL
[debug] Default format spec: bestvideo+bestaudio/best
[info] Writing video subtitles to: /home/bittaurus/lynda/Creating a Short Film - 07 Cinematography/11. Fixing Mistakes/83. Recreating the faceoff shot.en.srt
[debug] Invoking downloader on u'https://lynda_files2-a.akamaihd.net/secure/courses/129024/VBR_MP4h264_main_HD720/129024_12_03_MM24_depth.mp4?c3.ri=3770809745496079410&hashval=1505267522_1ca01fbf2743061da97904f40652f187'
[download] /home/bittaurus/lynda/Creating a Short Film - 07 Cinematography/11. Fixing Mistakes/83. Recreating the faceoff shot.mp4 has already been downloaded
[download] 100% of 10.88MiB
[download] Finished downloading playlist: Creating a Short Film: 07 Cinematography

Would you like me to open a new issue for this with a proper "verbose log that clearly demonstrates the issue", or is this enough to reopen this issue and proceed to divine where I have failed?

Post the output of youtube-dl --cookies /home/bittaurus/lynda/cookies.txt --playlist-start 84 --playlist-end 84 --list-sub https://www.lynda.com/Video-tutorials/Creating-Short-Film-07-Cinematography/129024-2.html.

[lynda:course] 129024: Downloading course JSON
[download] Downloading playlist: Creating a Short Film: 07 Cinematography
[lynda:course] playlist Creating a Short Film: 07 Cinematography: Collected 98 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
[lynda] 655941: Downloading video JSON
[lynda] 655941: Checking 1-540 video format URL
[lynda] 655941: Checking 1-720 video format URL
[lynda] 655941: Checking 1-360 video format URL
[lynda] 655941: Checking 0-540 video format URL
[lynda] 655941: Checking 0-720 video format URL
[lynda] 655941: Checking 0-360 video format URL
655941 has no subtitles
[download] Finished downloading playlist: Creating a Short Film: 07 Cinematography

You know, 30 minutes ago, there was a transcript available, and I was watching glorious subtitles in amazing resolution, but now... Lynda has forgotten it exists. My appologies to youtube-dl for defaming his reputation. I do hope he forgives me. Please tell him I'm sorry.

ytdl-org / youtube-dl