alzamer2 / Crunchyroll-XML-Decoder-py3

GNU General Public License v3.0
17 stars 5 forks source link

[Bug] Downloading with latest 1.4 #48

Closed Dokman closed 2 years ago

Dokman commented 3 years ago

Everytime i try to download i am having the same issue

KeyError: 'session_id'

image image image

alzamer2 commented 3 years ago

Is this new 1.4?

Dokman commented 3 years ago

Yes, latest 1.4 branch

alzamer2 commented 3 years ago

1.4 rev.32 is up and it should fix this problem

the problem is in new feature but its still under testing if the problem stay up, you can pass it by simply going to chrome browser and log in to your crunchyroll account there

reikitsune commented 3 years ago

I keep getting this from a clean install:

Booting up... Please enter Crunchyroll video URL:> https://www.crunchyroll.com/digimon-ghost-game/episode-1-the-sewn-lip-man-816959 Traceback (most recent call last): File "crunchy-xml-decoder-py3.py", line 402, in menutest.start() File "crunchy-xml-decoder\pretyconsole.py", line 128, in start_ self.run_menu('Main') File "crunchy-xml-decoder\pretyconsole.py", line 155, in runmenu output = function[0](*function[1], function[2]) File "crunchy-xml-decoder-py3.py", line 134, in ultimate ultimate_class.download(arg,kwarg) File "crunchy-xml-decoder\ultimate.py", line 302, in download self.download_episode() File "crunchy-xml-decoder\ultimate.py", line 77, in download_episode html_page_resp = gethtml(self.page_url, return_form = 'respond') File "crunchy-xml-decoder\altfuncs.py", line 493, in gethtml res = session.get(url, params=req, headers=headers) File "C:\Python38\lib\site-packages\requests\sessions.py", line 543, in get return self.request('GET', url, kwargs) File "C:\Python38\lib\site-packages\cloudscraper__init__.py", line 262, in request self.perform_request(method, url, args, kwargs) File "C:\Python38\lib\site-packages\cloudscraper__init__.py", line 181, in perform_request return super(CloudScraper, self).request(method, url, *args, kwargs) File "C:\Python38\lib\site-packages\requests\sessions.py", line 530, in request resp = self.send(prep, send_kwargs) File "C:\Python38\lib\site-packages\requests\sessions.py", line 665, in send history = [resp for resp in gen] File "C:\Python38\lib\site-packages\requests\sessions.py", line 665, in history = [resp for resp in gen] File "C:\Python38\lib\site-packages\requests\sessions.py", line 166, in resolve_redirects raise TooManyRedirects('Exceeded {} redirects.'.format(self.max_redirects), response=resp) requests.exceptions.TooManyRedirects: Exceeded 30 redirects. Press any key to continue . . .

Not sure if it's the same issue.

alzamer2 commented 3 years ago

are you using vpn? the error say that cloudflare scraper tried many times

reikitsune commented 3 years ago

are you using vpn? the error say that cloudflare scraper tried many times

I'm not currently, and Anti-virus is off to make sure too.

alzamer2 commented 3 years ago

just tried downloading same episod

┌──────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐ │ │ │ CrunchyRoll Downloader Toolkit │ │ │ │ If you don't have a premium account, go and sign up for one now. It's well worth it, and supports the animators.│ │ │ │ 1 - Download Anime │ │ 2 - Download Subtitle only │ │ 3 - Login │ │ 4 - Login As Guest │ │ 5 - Download an entire Anime(Autocatch links) │ │ 6 - Run Queue │ │ │ │ │ │ 999 - Settings │ │ │ │ │ │ 000 - Exit │ │ │ └──────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

1

---- Start New Export ----

CrunchyRoll Downloader Toolkit DX v0.98b Crunchyroll hasn't changed anything.

If you don't have a premium account, go and sign up for one now. It's well worth it, and supports the animators.


Booting up... Please enter Crunchyroll video URL:> https://www.crunchyroll.com/digimon-ghost-game/episode-1-the-sewn-lip-man-816959 Now Downloading - Digimon Ghost Game Episode 1 - THE SEWN-LIP MAN [HLS stream]

                                                                                                    46.46MB                                                                                                        |    @ 11.30Mb/s
                                                                                            Part#17 [2.92MB/2.92MB]                                                                                                |% 100.0 @ 212.4Mb/s

and it worked just fine can you retry download it again?

alzamer2 commented 3 years ago

just finished downloading it (@1080p), so what about you?

reikitsune commented 3 years ago

I'm still having the same error. What version of python are you using?

alzamer2 commented 3 years ago

i tested the code at 3.7 and 3.8 but it should work with 3.9+

what you version?

alzamer2 commented 3 years ago

can you copy the full concel text? from start to error!!

reikitsune commented 3 years ago

Python Version=3.8.2 64 bit OS Version=Windows 10 10.0.19041 SP0 System Type=AMD64 Code Version=1.4 rev.32 (Up-To-Date) colorama : installed! lxml : installed! wget : installed! cryptography.hazmat.primitives.ciphers : installed! cloudscraper : installed! m3u8 : installed! youtube_dl : installed! bs4 : installed! pager : installed! unidecode : installed! socks : installed! psutil : installed! browser_cookie3 : installed! MKVMERGE.EXE : Found! FFMPEG.EXE : Found! User Name = Crono_Flash Membership Type = Premium ┌──────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐ │ │ │ CrunchyRoll Downloader Toolkit │ │ │ │ If you don't have a {Green_c}premium{Default_c} account, go and sign up for one now. It's well worth it, and │ │ supports the animators. │ │ │ │ 1 - Download Anime │ │ 2 - Download Subtitle only │ │ 3 - Login │ │ 4 - Login As Guest │ │ 5 - Download an entire Anime(Autocatch links) │ │ 6 - Run Queue │ │ │ │ │ │ 999 - Settings │ │ │ │ 000 - Exit │ │ │ └──────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

1

---- Start New Export ----

CrunchyRoll Downloader Toolkit DX v0.98b Crunchyroll hasn't changed anything.

If you don't have a premium account, go and sign up for one now. It's well worth it, and supports the animators.


Booting up... Please enter Crunchyroll video URL:> https://www.crunchyroll.com/digimon-ghost-game/episode-1-the-sewn-lip-man-816959 Traceback (most recent call last): File "crunchy-xml-decoder-py3.py", line 402, in menutest.start() File "crunchy-xml-decoder\pretyconsole.py", line 128, in start_ self.run_menu('Main') File "crunchy-xml-decoder\pretyconsole.py", line 155, in runmenu output = function[0](*function[1], function[2]) File "crunchy-xml-decoder-py3.py", line 134, in ultimate ultimate_class.download(arg,kwarg) File "crunchy-xml-decoder\ultimate.py", line 302, in download self.download_episode() File "crunchy-xml-decoder\ultimate.py", line 77, in download_episode html_page_resp = gethtml(self.page_url, return_form = 'respond') File "crunchy-xml-decoder\altfuncs.py", line 493, in gethtml res = session.get(url, params=req, headers=headers) File "C:\Python38\lib\site-packages\requests\sessions.py", line 543, in get return self.request('GET', url, kwargs) File "C:\Python38\lib\site-packages\cloudscraper__init__.py", line 262, in request self.perform_request(method, url, args, kwargs) File "C:\Python38\lib\site-packages\cloudscraper__init__.py", line 181, in perform_request return super(CloudScraper, self).request(method, url, *args, kwargs) File "C:\Python38\lib\site-packages\requests\sessions.py", line 530, in request resp = self.send(prep, send_kwargs) File "C:\Python38\lib\site-packages\requests\sessions.py", line 665, in send history = [resp for resp in gen] File "C:\Python38\lib\site-packages\requests\sessions.py", line 665, in history = [resp for resp in gen] File "C:\Python38\lib\site-packages\requests\sessions.py", line 166, in resolve_redirects raise TooManyRedirects('Exceeded {} redirects.'.format(self.max_redirects), response=resp) requests.exceptions.TooManyRedirects: Exceeded 30 redirects. Press any key to continue . . .

alzamer2 commented 3 years ago

wired try using autocatch

reikitsune commented 3 years ago

Just tried it. Still the same error. I may just need to wait a little before I can use it.

alzamer2 commented 3 years ago

try oening the link in browser,maybe your ip adress is cloudflare blacklist

reikitsune commented 3 years ago

link works in both firefox and chrome. And can play the episode at 1080p.

Dokman commented 3 years ago

In my case it worked your last fix, I've relogged my account and then download and it was working

reikitsune commented 3 years ago

I switched the link to the beta version, and tried to just download the subs and got a different error. It's still cloudflare, but it's about the recaptcha.

---- Downloading Subtitle ----

Please enter Crunchyroll video URL: https://beta.crunchyroll.com/watch/G7PU4WE1V/the-sewn-lip-man cloudscraper.exceptions.CloudflareReCaptchaProvider: Cloudflare reCaptcha detected, unfortunately you haven't loaded an anti reCaptcha provider correctly via the 'recaptcha' parameter. Press any key to continue . . .

I even relogged in everytime, and get this consistently.

alzamer2 commented 3 years ago

its seem your ip is really blacklisted at crunchyroll/cloudflare is your ip fixed or it got changed every time you dial up/disconnect-reconnect with your isp?

alzamer2 commented 3 years ago

ok i have good news and bad news about "requests.exceptions.TooManyRedirects: Exceeded 30 redirects." error

good news i found the cause recently crunchy roll released beta site for new look and you can go test it out at beta.crunchyroll.com and here is bad news any US user will forcly redirct to beta site and no mather what you cant use classic site and as new site i need to rebuild scraping from zero so it will take sometime ps: beta site use some complicated method to build its site and i needed 2hr just to find first string

Dokman commented 3 years ago

It Will happen in Europe too

alzamer2 commented 3 years ago

damn , that meanss i better hurry up with fixing this issue

ps: us proxy is down so its better to turn it off until it get fixed

darkhelmet2016 commented 3 years ago

Tried that url and getting an error about the subs.

Traceback (most recent call last): File "crunchy-xml-decoder-py3.py", line 402, in menutest.start() File "crunchy-xml-decoder\pretyconsole.py", line 128, in start_ self.run_menu('Main') File "crunchy-xml-decoder\pretyconsole.py", line 155, in runmenu output = function[0](*function[1], function[2]) File "crunchy-xml-decoder-py3.py", line 134, in ultimate ultimate_class.download(arg,kwarg) File "crunchy-xml-decoder\ultimate.py", line 311, in download vilos_subtitle(self.page_url) File "crunchy-xml-decoder\altfuncs.py", line 720, in vilos_subtitle htmlpage = gethtml(pageurl) File "crunchy-xml-decoder\altfuncs.py", line 493, in gethtml res = session.get(url, params=req, headers=headers) File "C:\Users\AppData\Local\Programs\Python\Python37-32\lib\site-packages\requests\sessions.py", line 546, in get return self.request('GET', url, kwargs) File "C:\Users\AppData\Local\Programs\Python\Python37-32\lib\site-packages\cloudscraper__init__.py", line 239, in request super(CloudScraper, self).request(method, url, args, kwargs) File "C:\Users\AppData\Local\Programs\Python\Python37-32\lib\site-packages\requests\sessions.py", line 533, in request resp = self.send(prep, **send_kwargs) File "C:\Users\AppData\Local\Programs\Python\Python37-32\lib\site-packages\requests\sessions.py", line 668, in send history = [resp for resp in gen] if allow_redirects else [] File "C:\Users\AppData\Local\Programs\Python\Python37-32\lib\site-packages\requests\sessions.py", line 668, in history = [resp for resp in gen] if allow_redirects else [] File "C:\Users\AppData\Local\Programs\Python\Python37-32\lib\site-packages\requests\sessions.py", line 165, in resolve_redirects raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects, response=resp) requests.exceptions.TooManyRedirects: Exceeded 30 redirects. Press any key to continue . . .

alzamer2 commented 3 years ago

@darkhelmet2016 the problem is when classic site detects that you are in us or using USproxy it will redirect you to the beta site without asking

darkhelmet2016 commented 3 years ago

Yea, saw your comment but thought would post it anyway so you would know about the sub line too since did not see it mentioned in the other users log.

alzamer2 commented 3 years ago

ok i uploaded 1.4 rev.34 its support beta site but it still need work so it can support us proxy and autocath

darkhelmet2016 commented 3 years ago

Getting an error trying to use the downloader updater again.

trying to close Crunchyroll-XML-Decoder-py3....... ←[31mDownload failed←[0m, retry...1 ←[31mDownload failed←[0m, retry...2 ←[31mDownload failed←[0m, retry...3 ←[31mDownload failed←[0m, retry...4 ←[31mDownload failed←[0m, retry...5 Traceback (most recent call last): File ".\crunchy-xml-decoder\updater.py", line 183, in run_update() File ".\crunchy-xml-decoder\updater.py", line 175, in run_update update.run() File ".\crunchy-xml-decoder\updater.py", line 158, in run Print(f'{Red_c}Update file was not downloaded{Default_c}, please try to download file manualy from "https://github.com/alzamer2/Crunchyroll-XML-Decoder-py3/tree/{self.github_branch}"') NameError: name 'Print' is not defined Press any key to continue . . .

darkhelmet2016 commented 3 years ago

It is only downloading subs.

Dokman commented 2 years ago

@alzamer2 they applied to the beta website to EU