search

Jules-WinnfieldX / CyberDropDownloader

Bulk Gallery Downloader for Cyberdrop.me and Other Sites
GNU General Public License v3.0
1.63k stars 185 forks source link

[BUG] Errors on certain PixelDrain URLs: unconverted data remains: Z #862

Closed baccccccc closed 6 months ago

baccccccc commented 6 months ago

here are three perfectly good PD URLs. (likely NSFW)

https://pixeldrain.com/u/ZdqEY5dL, See Log for Details
https://pixeldrain.com/u/FxFhH1SD, See Log for Details
https://pixeldrain.com/u/PR5zNRvf, See Log for Details

for some unclear reasons, CDL scrapper does not like them.

INFO     : 2024-03-28 22:39:58,157 : utilities.py:98 : Scrape Starting: https://pixeldrain.com/u/ZdqEY5dL
ERROR    : 2024-03-28 22:39:58,656 : utilities.py:98 : Scrape Failed: https://pixeldrain.com/u/ZdqEY5dL (unconverted data remains: Z)
ERROR    : 2024-03-28 22:39:58,679 : utilities.py:98 : Traceback (most recent call last):
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\utils\utilities.py", line 62, in wrapper
    return await func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\scraper\crawlers\pixeldrain_crawler.py", line 63, in file
    date = await self.parse_datetime(JSON_Resp['date_upload'].replace("T", " ").split(".")[0])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\scraper\crawlers\pixeldrain_crawler.py", line 72, in parse_datetime
    date = datetime.datetime.strptime(date, "%Y-%m-%d %H:%M:%S")
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64__qbz5n2kfra8p0\Lib\_strptime.py", line 554, in _strptime_datetime
    tt, fraction, gmtoff_fraction = _strptime(data_string, format)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64__qbz5n2kfra8p0\Lib\_strptime.py", line 336, in _strptime
    raise ValueError("unconverted data remains: %s" %
ValueError: unconverted data remains: Z

INFO     : 2024-03-28 22:39:58,681 : utilities.py:98 : Scrape Finished: https://pixeldrain.com/u/ZdqEY5dL

INFO     : 2024-03-28 22:43:04,021 : utilities.py:98 : Scrape Starting: https://pixeldrain.com/u/FxFhH1SD
ERROR    : 2024-03-28 22:43:04,517 : utilities.py:98 : Scrape Failed: https://pixeldrain.com/u/FxFhH1SD (unconverted data remains: Z)
ERROR    : 2024-03-28 22:43:04,518 : utilities.py:98 : Traceback (most recent call last):
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\utils\utilities.py", line 62, in wrapper
    return await func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\scraper\crawlers\pixeldrain_crawler.py", line 63, in file
    date = await self.parse_datetime(JSON_Resp['date_upload'].replace("T", " ").split(".")[0])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\scraper\crawlers\pixeldrain_crawler.py", line 72, in parse_datetime
    date = datetime.datetime.strptime(date, "%Y-%m-%d %H:%M:%S")
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64__qbz5n2kfra8p0\Lib\_strptime.py", line 554, in _strptime_datetime
    tt, fraction, gmtoff_fraction = _strptime(data_string, format)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64__qbz5n2kfra8p0\Lib\_strptime.py", line 336, in _strptime
    raise ValueError("unconverted data remains: %s" %
ValueError: unconverted data remains: Z

INFO     : 2024-03-28 22:43:04,520 : utilities.py:98 : Scrape Finished: https://pixeldrain.com/u/FxFhH1SD

INFO     : 2024-03-28 22:45:43,072 : utilities.py:98 : Scrape Starting: https://pixeldrain.com/u/PR5zNRvf
ERROR    : 2024-03-28 22:45:43,489 : utilities.py:98 : Scrape Failed: https://pixeldrain.com/u/PR5zNRvf (unconverted data remains: Z)
ERROR    : 2024-03-28 22:45:43,489 : utilities.py:98 : Traceback (most recent call last):
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\utils\utilities.py", line 62, in wrapper
    return await func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\scraper\crawlers\pixeldrain_crawler.py", line 63, in file
    date = await self.parse_datetime(JSON_Resp['date_upload'].replace("T", " ").split(".")[0])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\<username>\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.12_qbz5n2kfra8p0\LocalCache\local-packages\Python312\site-packages\cyberdrop_dl\scraper\crawlers\pixeldrain_crawler.py", line 72, in parse_datetime
    date = datetime.datetime.strptime(date, "%Y-%m-%d %H:%M:%S")
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64__qbz5n2kfra8p0\Lib\_strptime.py", line 554, in _strptime_datetime
    tt, fraction, gmtoff_fraction = _strptime(data_string, format)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.752.0_x64__qbz5n2kfra8p0\Lib\_strptime.py", line 336, in _strptime
    raise ValueError("unconverted data remains: %s" %
ValueError: unconverted data remains: Z

INFO     : 2024-03-28 22:45:43,491 : utilities.py:98 : Scrape Finished: https://pixeldrain.com/u/PR5zNRvf
Jules-WinnfieldX commented 6 months ago

5.2.15 will fix this.