Fr75s / bigscraperqt

Easy to use GUI Scraping tool; supports LaunchBox and more
https://fr75s.github.io/bigscraperqt
GNU General Public License v3.0
7 stars 1 forks source link

Error with screenscraper folder #4

Closed Sebio1980 closed 1 year ago

Sebio1980 commented 1 year ago

Hello, OS Version : [pixL-Beta28] Linux OS Debian Ubuntu 18.04

Machine Configuration CPU : I7-6820 GPU : GeForce GTX 1080 mobile System Storage device : USB box SSD M.2

when i launch scrap i have this issue :

[I] Program Init... 2022-10-15 18:01:07
[I] Starting application
[I] bigscraper-qt v1.4.0. Made by Fr75s. Licensed under GPLv3
QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-root'
[I] Reading options file
[D] Saved Options to File
[I] QML Loaded
[U] Selected Folder (file:///recalbox/share/roms/snes)
[U] Selected System (Super Nintendo Entertainment System)
-----
[I] Begin Task: Scrape Folder
-----
[I] Data is ['file:///recalbox/share/roms/snes', 'Super Nintendo Entertainment System']
[I] Will write to /recalbox/share/system/.local/share/bigscraper-qt/
[I] Scraping from ScreenScraper
[O] Starting...
[I] Data formatted to [['MICRO_MACHINES', 'MEGA_MAN_7'], ['/recalbox/share/roms/snes/Micro Machines (Europe).zip', '/recalbox/share/roms/snes/Mega Man 7 (Europe).zip'], 'snes', 4]
[I] Getting User Page
[O] Showing Main Bar
[O] Hiding Game Bar
[O] Getting User Page
[D] Page Request Successful
[D] ScreenScraper Requests As of this line: 10
[D] Maximum alotted requests: 300000
[D] Max number of threads: 7
[D] Threadpool Maximum Capacity: 7
[I] Initializing Thread for MICRO_MACHINES
[D] GAME FILE: /recalbox/share/roms/snes/Micro Machines (Europe).zip
[D] SYSTEM INFO: 4, snes, Super Nintendo Entertainment System
[D] Thread Start
[D] ['file:///recalbox/share/roms/snes', 'Super Nintendo Entertainment System']
[D] {'video': True, 'videoOverLimit': False, 'glassyTitle': True, 'recache': False, 'localPaths': False, 'region': 'Europe', 'module': 'ScreenScraper', 'languageOverride': 'None', 'screenScraperUser': 'xxxxxxx', 'screenScraperPass': 'xxxxxxx'}
[D] ['MICRO_MACHINES', '/recalbox/share/roms/snes/Micro Machines (Europe).zip', 'https://www.screenscraper.fr/api2/jeuInfos.php?devid=Fr75s&devpassword=YlxdDSIEUgv&softname=bigscraperqt&output=json&ssid=xxxxxx&sspassword=xxxxxx', [4, 'snes', 'Super Nintendo Entertainment System']]
[D] MD5 Hash: 17aee32a91e4555d5aa3c75863247db8
[D] SHA1 Hash: f8a29e5113d2142d6562229e5d2f5915287ca824
[D] CRC32 Hash: 1906809994, CRC32 Hex-Formatted Hash: 71a79c8a
[I] Attempting to get page for MICRO_MACHINES
[I] Initializing Thread for MEGA_MAN_7
[D] GAME FILE: /recalbox/share/roms/snes/Mega Man 7 (Europe).zip
[D] SYSTEM INFO: 4, snes, Super Nintendo Entertainment System
[D] Thread Start
[D] ['file:///recalbox/share/roms/snes', 'Super Nintendo Entertainment System']
[D] {'video': True, 'videoOverLimit': False, 'glassyTitle': True, 'recache': False, 'localPaths': False, 'region': 'Europe', 'module': 'ScreenScraper', 'languageOverride': 'None', 'screenScraperUser': 'xxxxxxx', 'screenScraperPass': 'xxxxxxxx'}
[D] ['MEGA_MAN_7', '/recalbox/share/roms/snes/Mega Man 7 (Europe).zip', 'https://www.screenscraper.fr/api2/jeuInfos.php?devid=Fr75s&devpassword=YlxdDSIEUgv&softname=bigscraperqt&output=json&ssid=xxxxxx&sspassword=xxxxxxx', [4, 'snes', 'Super Nintendo Entertainment System']]
[D] MD5 Hash: 99709a16eea3374f456d9ba7eef36ae4
[D] SHA1 Hash: 6e2e13fd072c39605d0fcddf4cca88b435c987ba
[D] CRC32 Hash: 817841714, CRC32 Hex-Formatted Hash: 30bf4632
[I] Attempting to get page for MEGA_MAN_7
[D] (MICRO_MACHINES) Page Request Successful
[I] (MICRO_MACHINES) Collecting Game Metadata
[D] Checking for Game Name
[D] Adding Game Name
[D] Checking for Game Release
[D] Checking for Game Release
[D] Checking for Game Release
[D] Checking for Game Release
Traceback (most recent call last):
  File "/tmp/.mount_bigscrVxKUg5/usr/lib/python3.10/site-packages/bsqt/scrapemany.py", line 856, in run
    meta["Release Date"] = [calendar_month_rev[rd_raw[1]] + " " + rd_raw[2] + ", " + rd_raw[0]]
IndexError: list index out of range
Aborted

Thank you for help

Fr75s commented 1 year ago

This issue should be fixed in 1601d5d. I didn't realize that ScreenScraper sometimes only has release dates with single years, but at least this issue wasn't too hard to fix, and helped me realize that multi-threaded ScreenScraper scraping does work.

Thank you for submitting this issue.