Ascoware / get-iplayer-automator

The goal of Get iPlayer Automator is to allow iTunes and your Mac to become the hub for your British Television experience regardless of where in the world you are. Currently, Get iPlayer Automator allows you to download and watch BBC and ITV shows on your Mac. Series-Link/PVR functionality ensures you will never miss your favourite shows. Programmes are fully tagged and added to iTunes automatically upon completion. It is simple and easy to use, and runs on any machine running Mac OS X 10.7 or later. And since the shows are in iTunes, it is extremely easy to transfer them to your iPod, iPhone, or Apple TV allowing you to enjoy your shows on the go or on your television.
GNU General Public License v3.0
144 stars 27 forks source link

ITV Shows not Downloading on Monterey 12.3 (Beta) #383

Closed pebceb closed 2 years ago

pebceb commented 2 years ago

BBC shows will download but iTV shows keep failing in the latest Beta of MAC OS Monterey 12.3.

I know you probably do not worry about doing fixes for Betas but is this a known issue?

Thank you.

Peter

skovatch commented 2 years ago

This is because Apple removed python 2.7 from macOS 12.3. Until I figure out how to bundle yt-dlp in a backwards-compatible fashion you'll have to install one yourself from python.org.

pebceb commented 2 years ago

Okay thanks for the update. Good to know. For now I just went back to OS 12.2.

Peter

pebceb commented 2 years ago

Scott,

Another couple of questions if I may.

Will Python work on an M1 Mac?

Do I have to do anything other than installing the python app if I decide to try this?

I upgraded to the beta again and installed python but still not working. What do I have to do with python once installed to get this to work? Thanks very much.

**Update - I found the version you created with python in it and it works for ITV shows. Using it on an Intel MacBook Pro. I might get brave up upgrade my Mac Mini M1 and try it there. (https://drive.google.com/drive/folders/15-PmyvvmmPDxe8sAHIM-94U-9VJ0S-UW)

It does have the problem where it does not update the ITV shows though. Any chance you can fix this beta version for that problem? The first time I tried it - it asked to update and fixed that problem but then the ITV shows would not work again. Manual adding of shows from the web browser works fine.**

Peter

WilliamOfGaunt commented 2 years ago

I’ve just encountered a bit of an oddity with ITV on Monterey 12.1 and GiA 1.21.15: On forcing a cache update just now an episode of The Good Karma Hospital was available, but when I downloaded it there was no series title, just the episode number. And no folder containing a file was downloaded. But when I checked the folder from my PC over the network I found the missing file not in a folder: the filename was prefixed by a period, which rendered it invisible to MacOS.

Deleting the period from the PC revealed the file. Interesting, perhaps.

Bruce

From: pebceb Sent: Saturday, February 12, 2022 10:20 AM To: Ascoware/get-iplayer-automator Cc: Subscribed Subject: [Ascoware/get-iplayer-automator] ITV Shows not Downloading on Monterey 12.3 (Beta) (Issue #383)

BBC shows will download but iTV shows keep failing in the latest Beta of MAC OS Monterey 12.3.

I know you probably do not worry about doing fixes for Betas but is this a known issue?

Thank you.

Peter

— Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android. You are receiving this because you are subscribed to this thread.Message ID: @.***>

pebceb commented 2 years ago

I was just wondering if you will be doing an update to include python once Monterey 12.3 is released?

Thanks.

Peter

skovatch commented 2 years ago

I was just wondering if you will be doing an update to include python once Monterey 12.3 is released?

That's my intention, yes. I have to figure out how to build one library so it will load on older versions of macOS.

pebceb commented 2 years ago

Thanks Scott

andyjw7 commented 2 years ago

Until I figure out how to bundle yt-dlp in a backwards-compatible fashion you'll have to install one yourself from python.org.

Hi @skovatch - I've downloaded and installed the latest Python installed from Python.org, as you suggested, but ITV downloads still fail. I assume I'm missing some vital step, but I don't have a clue what that is. Would you be able to enlighten me? Thanks in advance.

skovatch commented 2 years ago

You need a Python 2.x version, not Python 3 -- sorry, I should have clarified that.

andyjw7 commented 2 years ago

Thanks for your reply. I just installed Python 2.7.18 but that didn't work either - ITV programs still fail to download. I'm using Get iPlayer Automator 1.22.1.

sxmpete commented 2 years ago

FYI, GIA 1.22.1 under Monterey/Python 2.7.17 will DL from ITV but so VERY slowly I did not wait for it to complete. Downie works like a charm and is much faster. (BTW, did you create the symlink to python after installing?)

pebceb commented 2 years ago

What is the symlink?

sxmpete commented 2 years ago

After you install Python, you have to 'link' it to GIA, via the following terminal command:

ln -sf /usr/local/bin/python2 /Applications/Get\ iPlayer\ Automator.app/Contents/MacOS/python

This is explained in Issue 277 on Github (GIA)

Hope this helps, Peter

On Sun, Mar 20, 2022 at 3:51 PM Peter @.***> wrote:

What is the symlink?

— Reply to this email directly, view it on GitHub https://github.com/Ascoware/get-iplayer-automator/issues/383#issuecomment-1073337561, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGZX3OOYFFDZEM3P7YTRDNTVA56VVANCNFSM5OGR6WSQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you commented.Message ID: @.***>

-- Regards, Peter

pebceb commented 2 years ago

Thanks Peter.

pebceb commented 2 years ago

Update.

I have tried and am obviously doing something wrong. When I run that command in terminal I keep getting "no such file or directory". Do I have to change something?

sxmpete commented 2 years ago

Unfortunately, I'm not familiar with Unix commands. It just worked for me. The ln command assumes that the python install puts files in standard places and that GIA is in the Applications folder, at the top level. If that's not the case, perhaps you could try to re-install python and GIA plus the symlink command. Other than that, suggest you reach out to some Unix knowledgeable folk on this board.

On Mon, Mar 21, 2022 at 6:53 AM Peter @.***> wrote:

Update.

I have tried and am obviously doing something wrong. When I run that command in terminal I keep getting "no such file or directory". Do I have to change something?

— Reply to this email directly, view it on GitHub https://github.com/Ascoware/get-iplayer-automator/issues/383#issuecomment-1073751068, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGZX3OOMRQO5QOLH3UELBSLVBBIKJANCNFSM5OGR6WSQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you commented.Message ID: @.***>

-- Regards, Peter

pebceb commented 2 years ago

Okay thanks Peter.

pebceb commented 2 years ago

Good day Scott.

Any update on your work to get a new version that will work with Monterey 12.3?

Thanks.

Peter

skovatch commented 2 years ago

Sorry, I haven't had much time recently between starting a new job and a kitchen remodel getting underway. I hope to look at it again soon.

WilliamOfGaunt commented 2 years ago

From where I sit, I don’t think you have anything to apologize for – in my view we’re all in your debt for all the work you’ve put into the project.

Bruce

From: Scott Kovatch Sent: Saturday, March 26, 2022 4:04 AM To: Ascoware/get-iplayer-automator Cc: WilliamOfGaunt ; Comment Subject: Re: [Ascoware/get-iplayer-automator] ITV Shows not Downloading on Monterey 12.3 (Beta) (Issue #383)

Sorry, I haven't had much time recently between starting a new job and a kitchen remodel getting underway. I hope to look at it again soon.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

pebceb commented 2 years ago

I agree. I was just curious and not trying to be pushy. We all appreciate the amazing work you do.

Good luck with the new job and the reno!

Peter

Lordsnooty05 commented 2 years ago

Scott you do an amazing job on here. This is a fabulous app and I wouldn’t be without it. So thanks from me for all you do for keeping it running. Good luck with your new job Harry

skovatch commented 2 years ago

I appreciate the kind words! It's a fair question since I did say I would have an update by the time macOS 12.3 shipped, but it hasn't worked out that way. I need to build libssl v3 for x86_64 and arm64, and make it compatible with macOS 11. I have a working solution with yt-dlp and a self-contained python 3 but it's macOS 12-only right now. If everyone was on Monterey I would release what I have, but I know that's not the case.

skovatch commented 2 years ago

I think I've figured out how to build libssl and libcrypto correctly, so please give the test version attached to https://github.com/Ascoware/get-iplayer-automator/discussions/374 a try and let me know if it's working.

pebceb commented 2 years ago

Thanks Scott!

Downloaded and tested on my Macbook Pro Intel with OS 12.3. Works great for both ITV and BBC and also caches the shows as it should.

On my Mac Mini M1, also OS 12.3, when I download the files I do not get the app icon when I open the zip folder - only the contents folder.

So I am not sure how to get it installed and working from that. But what I did was copy the app over from my Intel Macbook and then it works fine.

Is there some other step to get it installed on an M1 mac when you only see the contents folder?

Great work and thanks again.

Peter

HeyHeyWhatWhat commented 2 years ago

M1 iMac, Monterey 12.3 - BBC Radio 4 downloads working. Great stuff and many thanks.

pebceb commented 2 years ago

HeyHeyWhatWhat.

How did you get it installed on your M1 Mac? See my comments above.

Thanks.

HeyHeyWhatWhat commented 2 years ago

Hi pebceb. I downloaded from here and the use ready file was just put in my applications folder: https://drive.google.com/drive/folders/15-PmyvvmmPDxe8sAHIM-94U-9VJ0S-UW

pebceb commented 2 years ago

Thanks.

I tried with that same link before and it did what I posted above - just tried again from your posted link and it worked fine.

Sorry was on the wrong machine (intel). Still does the same thing on my M1 Mac Mini.

Peter

pebceb commented 2 years ago

Screen Shot 2022-03-28 at 09 17 14 Screenshot of what I see when I unzip the file.

jeanpaulz85 commented 2 years ago

I tried to installed Python 2.7.17 and tried what you recommended and it did not work on my M! 12.3

On Mar 28, 2022, at 15:15, Peter @.***> wrote:

Thanks.

I tried with that same link before and it did what I posted above - just tried again from your posted link and it worked fine.

Peter

— Reply to this email directly, view it on GitHub https://github.com/Ascoware/get-iplayer-automator/issues/383#issuecomment-1080635727, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGWP7IUKBUQYAIN7BQYMNJ3VCGWGHANCNFSM5OGR6WSQ. You are receiving this because you are subscribed to this thread.

HeyHeyWhatWhat commented 2 years ago

Here's the working version I have in my M1 Monterery 12.3 application folder that I downloaded from skovatch:

https://drive.google.com/file/d/14Gh866QmE_ly-CrmSnGP5ntvyeF5lYrv/view?usp=sharing

pebceb commented 2 years ago

Here's the working version I have in my M1 Monterery 12.3 application folder that I downloaded from skovatch:

https://drive.google.com/file/d/14Gh866QmE_ly-CrmSnGP5ntvyeF5lYrv/view?usp=sharing

Thanks. Funny that the app icon does not show.

I am okay with mine as I moved a copy over form my Intel Mac. Maybe if I had just copied the folder over it would have worked?

Have a great day and thanks for answering.

Peter

HeyHeyWhatWhat commented 2 years ago

You're welcome. All the best.

pebceb commented 2 years ago

Final thank you to Scott for all his great work in updating the app to work with Monterey 12.3.👍🏼

skovatch commented 2 years ago

Done in v1.23.0

pebceb commented 2 years ago

Good morning Scott.

Apologies for coming direct but I am finding this really frustrating.

I just did the update on my MacBook Pro (Intel) to 1.24.1 and the ITV shows are still failing to download. Still getting unknown error. Everything works fine on my M1 Mac Mini. (Both on Monterey).

Could it have anything to do with having tried to install my own python after upgrading to Monterey?

I tried re-downloading and installing the latest update directly from the web site as well and still not working.

Any suggestions? It was working fine before the last two updates.

Peter

pebceb commented 2 years ago

This is in the log (but it fails):

Get iPlayer Automator 1.24.1 Initialized. GetITVShows: ITV Cache Update Starting <AppController: 0x7fcf1a934bc0>: Updating Programme Index Feeds...

INFO: Indexing tv programmes (concurrent) GetITVShows (Info): Programmes: 576 INFO: Added 0 tv programmes to cache INFO: 7269 matching programmes GetITVShows (Info): Episodes: 7972 GetITVShows: Update Finished <AppController: 0x7fcf1a934bc0>: Index Updated.

INFO: Loading proxy settings... INFO: No proxy to load INFO: Proxy load complete. INFO: No proxy will be used AppController: Starting Downloads

Downloading Show 1/1:

Downloading Classic Emmerdale INFO: Preparing Request for Auth Info INFO: Metadata processed. youtube-dl finished downloading AppController: Downloads Finished

On Jun 28, 2022, at 07:22, Peter Brown @.***> wrote:

Good morning Scott.

Apologies for coming direct but I am finding this really frustrating.

I just did the update on my MacBook Pro (Intel) to 1.24.1 and the ITV shows are still failing to download. Still getting unknown error. Everything works fine on my M1 Mac Mini. (Both on Monterey).

Could it have anything to do with having tried to install my own python after upgrading to Monterey?

I tried re-downloading and installing the latest update directly from the web site as well and still not working.

Any suggestions? It was working fine before the last two updates.

Peter

pebceb commented 2 years ago

Just saw in another post about verbose mode. Here is full log:

Get iPlayer Automator 1.24.1 Initialized. GetITVShows: ITV Cache Update Starting <AppController: 0x7fc4a8813280>: Updating Programme Index Feeds...

INFO: Indexing tv programmes (concurrent) GetITVShows (Info): Programmes: 576 INFO: Added 4 tv programmes to cache INFO: 7271 matching programmes GetITVShows (Info): Episodes: 7974 GetITVShows: Update Finished <AppController: 0x7fc4a8813280>: Index Updated.

INFO: Loading proxy settings... INFO: No proxy to load INFO: Proxy load complete. INFO: No proxy will be used AppController: Starting Downloads

Downloading Show 1/1:

Downloading Classic Emmerdale INFO: Preparing Request for Auth Info INFO: Requesting Metadata. DEBUG: Metadata response status code: 200 INFO: Metadata processed. DEBUG: youtube-dl args:["https://www.itv.com/hub/classic-emmerdale/Ya0524a3116", "--user-agent", "Mozilla/5.0", "-f", "mp4/best", "-o", "/Users/peterbrown/Movies/TV Shows/Classic Emmerdale/Classic Emmerdale.s01e3116.Jun 27, 2022.%(ext)s", "--verbose", "--embed-metadata", "--embed-thumbnail", "--ppa", "AtomicParsley:--stik value=10"] DEBUG: youtube-dl environment: ["PATH": "/Applications/Get iPlayer Automator-P2.app/Contents/Resources/yt-dlp_macos:/Applications/Get iPlayer Automator-P2.app/Contents/Resources/get_iplayer/utils/bin", "SSL_CERT_FILE": "/Applications/Get iPlayer Automator-P2.app/Contents/Resources/cacert.pem"] [debug] Command-line config: ['https://www.itv.com/hub/classic-emmerdale/Ya0524a3116', '--user-agent', 'Mozilla/5.0', '-f', 'mp4/best', '-o', '/Users/peterbrown/Movies/TV Shows/Classic Emmerdale/Classic Emmerdale.s01e3116.Jun 27, 2022.%(ext)s', '--verbose', '--embed-metadata', '--embed-thumbnail', '--ppa', 'AtomicParsley:--stik value=10'] [debug] Encodings: locale US-ASCII, fs utf-8, out ascii (No ANSI), err ascii (No ANSI), pref US-ASCII [debug] yt-dlp version 2021.12.27 [6223f67a8] (mac_dir) [debug] Python version 3.9.9 (CPython 64bit) - macOS-12.4-x86_64-64bit [debug] exe versions: ffmpeg 4.3.2-tessus [debug] Optional libraries: Cryptodome, sqlite [debug] Proxy map: {} [debug] Using fake IP 25.152.251.25 (GB) as X-Forwarded-For [debug] [ITV] Extracting URL: https://www.itv.com/hub/classic-emmerdale/Ya0524a3116 [ITV] Ya0524a3116: Downloading webpage ERROR: [ITV] Ya0524a3116: Unable to download webpage: The read operation timed out (caused by timeout('The read operation timed out')); please report this issue on https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; see https://github.com/yt-dlp/yt-dlp on how to update. Be sure to call yt-dlp with the --verbose flag and include its complete output. (caused by timeout('The read operation timed out')); please report this issue on https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; see https://github.com/yt-dlp/yt-dlp on how to update. Be sure to call yt-dlp with the --verbose flag and include its complete output. File "yt_dlp/extractor/common.py", line 717, in _request_webpage File "yt_dlp/YoutubeDL.py", line 3458, in urlopen File "urllib/request.py", line 517, in open File "urllib/request.py", line 534, in _open File "urllib/request.py", line 494, in _call_chain File "yt_dlp/utils.py", line 1392, in https_open File "urllib/request.py", line 1350, in do_open File "http/client.py", line 1377, in getresponse File "http/client.py", line 320, in begin File "http/client.py", line 281, in _read_status File "socket.py", line 704, in readinto File "ssl.py", line 1241, in recv_into File "ssl.py", line 1099, in read youtube-dl finished downloading AppController: Downloads Finished

On Jun 28, 2022, at 07:28, Peter Brown @.***> wrote:

This is in the log (but it fails):

Get iPlayer Automator 1.24.1 Initialized. GetITVShows: ITV Cache Update Starting <AppController: 0x7fcf1a934bc0>: Updating Programme Index Feeds...

INFO: Indexing tv programmes (concurrent) GetITVShows (Info): Programmes: 576 INFO: Added 0 tv programmes to cache INFO: 7269 matching programmes GetITVShows (Info): Episodes: 7972 GetITVShows: Update Finished <AppController: 0x7fcf1a934bc0>: Index Updated.

INFO: Loading proxy settings... INFO: No proxy to load INFO: Proxy load complete. INFO: No proxy will be used AppController: Starting Downloads

Downloading Show 1/1:

Downloading Classic Emmerdale INFO: Preparing Request for Auth Info INFO: Metadata processed. youtube-dl finished downloading AppController: Downloads Finished

On Jun 28, 2022, at 07:22, Peter Brown @. @.>> wrote:

Good morning Scott.

Apologies for coming direct but I am finding this really frustrating.

I just did the update on my MacBook Pro (Intel) to 1.24.1 and the ITV shows are still failing to download. Still getting unknown error. Everything works fine on my M1 Mac Mini. (Both on Monterey).

Could it have anything to do with having tried to install my own python after upgrading to Monterey?

I tried re-downloading and installing the latest update directly from the web site as well and still not working.

Any suggestions? It was working fine before the last two updates.

Peter

skovatch commented 2 years ago

This error makes me think that your intel laptop's networking changed in such a way that ITV is rejecting connections. Are you on a VPN? Can you try downloading an older version of GiA to see if you still see the problem there?

pebceb commented 2 years ago

Hi Scott,

I am on a VPN as I am in Canada. I tried using an earlier version and it still does it, which is weird since it was working until I did the update.

Any hints on how to fix the networking issue if that is it. Maybe try a different VPN?

Thanks.

Peter

Sent from my iPad

On Jun 28, 2022, at 12:33, Scott Kovatch @.***> wrote:

 This error makes me think that your intel laptop's networking changed in such a way that ITV is rejecting connections. Are you on a VPN? Can you try downloading an older version of GiA to see if you still see the problem there?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.

skovatch commented 2 years ago

You might try asking your VPN provider if they can help, though if you can watch ITV shows in a browser window they may not be able to help. If that's the case, ask them to try installing yt-dlp or youtube-dl and see if that gives them some ideas.

pebceb commented 2 years ago

Scott,

Okay you were right about the vpn. I just tried with a different one and it’s working again.

I’ll try uninstalling and re-installing my main VPN to see if I can get that working.

Thanks for taking the time to answer and being so responsive.

Cheers.

Peter

On Jun 28, 2022, at 12:47, Scott Kovatch @.***> wrote:

You might try asking your VPN provider if they can help, though if you can watch ITV shows in a browser window they may not be able to help. If that's the case, ask them to try installing yt-dlp or youtube-dl and see if that gives them some ideas.

— Reply to this email directly, view it on GitHub https://github.com/Ascoware/get-iplayer-automator/issues/383#issuecomment-1168974249, or unsubscribe https://github.com/notifications/unsubscribe-auth/AT6UMSXRTKQTSFXAP5YADZLVRMUB3ANCNFSM5OGR6WSQ. You are receiving this because you authored the thread.

pebceb commented 2 years ago

Thanks Scott.

Just finished a chat with my VPN provider. Was trying dedicated IP but app was acting up and not getting the External IP. Got it sorted and now download is working.

Cheers for the VPN steer.

Peter

On Jun 28, 2022, at 12:47, Scott Kovatch @.***> wrote:

You might try asking your VPN provider if they can help, though if you can watch ITV shows in a browser window they may not be able to help. If that's the case, ask them to try installing yt-dlp or youtube-dl and see if that gives them some ideas.

— Reply to this email directly, view it on GitHub https://github.com/Ascoware/get-iplayer-automator/issues/383#issuecomment-1168974249, or unsubscribe https://github.com/notifications/unsubscribe-auth/AT6UMSXRTKQTSFXAP5YADZLVRMUB3ANCNFSM5OGR6WSQ. You are receiving this because you authored the thread.