christianhaitian
commented
1 month ago I can't replicate this issue on my end. As an example, I scraped my list of 50 NES roms that had not been previously scraped. Then added a couple of additional roms and scraped them again and it only scraped the 2 additional roms I added. Are you using scraped roms and gamelist.xml from another setup that is possibly not recognized by scraper in the ES used by ArkOS? The scraper used here is expecting the gamelist.xml to have entries similar to the following:
<?xml version="1.0"?>
<gameList>
<game>
<path>./Contra I.zip</path>
<name>Contra</name>
<desc>In the year 2631, a small meteorite has fallen into the Galuga archipelago, located 20km northeast off the coast of New Zealand. Two years later, a terrorist group known as Red Falcon has seized the island in preparation for an alien invasion. The earth's marines sent two members of their elite Contra unit, Bill Rizer and Lance Bean, to neutralize the terrorists.
As either, Bill (player 1) or Lance (player 2), the player must get to the end of each stage, shooting everything in sight, while avoiding enemy fire themselves. The player can upgrade their standard-issue rifle into one of four different weapons, including the powerful spread shot.</desc>
<image>./images/Contra I-image.png</image>
<marquee>./images/Contra I-marquee.png</marquee>
<thumbnail>./images/Contra I-thumb.png</thumbnail>
<rating>0.9</rating>
<releasedate>19880202T000000</releasedate>
<developer>Konami</developer>
<publisher>Konami</publisher>
<genre>Shooter / Run and Gun</genre>
<players>2</players>
<playcount>1</playcount>
<lastplayed>20240214T145245</lastplayed>
</game>
<game>
<path>./Contra II - Super C.zip</path>
<name>Contra</name>
<desc>In the year 2631, a small meteorite has fallen into the Galuga archipelago, located 20km northeast off the coast of New Zealand. Two years later, a terrorist group known as Red Falcon has seized the island in preparation for an alien invasion. The earth's marines sent two members of their elite Contra unit, Bill Rizer and Lance Bean, to neutralize the terrorists.
As either, Bill (player 1) or Lance (player 2), the player must get to the end of each stage, shooting everything in sight, while avoiding enemy fire themselves. The player can upgrade their standard-issue rifle into one of four different weapons, including the powerful spread shot.</desc>
<image>./images/Contra II - Super C-image.png</image>
<marquee>./images/Contra II - Super C-marquee.png</marquee>
<thumbnail>./images/Contra II - Super C-thumb.png</thumbnail>
<rating>0.9</rating>
<releasedate>19880202T000000</releasedate>
<developer>Konami</developer>
<publisher>Konami</publisher>
<genre>Shooter / Run and Gun</genre>
<players>2</players>
</game>
<game>
<path>./Super Mario Bros III.zip</path>
<name>Super Mario Bros. 3</name>
<desc>Bowser is back, and along with the Bowser kids, he's out to spoil Mario's day once again.
This time, along with nabbing the Princess, the Bowser crew have also taken the magic wands from the Kings of each land and turned them into creatures.
It's up to Mario and Luigi to get back the magic wands, defeat Bowser, and save the Princess all before the day is done.
Old and new power-ups abound in each level for the Mario Brothers, including the return of the Super Mushroom and Fire Flower, plus the new power-ups including the frog suit, the warp flute, and the most important of all, the leaf, which allows the player to fly and attack enemies with your tail.</desc>
<image>./images/Super Mario Bros III-image.png</image>
<marquee>./images/Super Mario Bros III-marquee.png</marquee>
<thumbnail>./images/Super Mario Bros III-thumb.png</thumbnail>
<rating>0.95</rating>
<releasedate>19900212T000000</releasedate>
<developer>Nintendo</developer>
<publisher>Nintendo</publisher>
<genre>Platform</genre>
<players>1-2</players>
<playcount>5</playcount>
<lastplayed>20240214T152003</lastplayed>
</game>
</gameList>If your gamelist is not similar to this, the scraper may assume that your games have missing medias and rescrape them in order to follow this standard.
Dochartaigh
Describe the Issue (If applicable)
Scraping with the "only missing medias" option scrapes the ENTIRE game directory, and not just games with missing media.
How can the issue be reproduced? (If applicable)
Start > Scraper > Scrape Now (have my ScrenScraper.fr user/pass setup already) > Filter: "only missing medias" > Select your system(s) --only 1x in my case > Start... and you'll see it's re-scraping EVERYTHING all over again and not just the SINGLE game I added.
What device are you using?
Powkiddy RGB30 V2 (assume it's v2 since I have the newer buttons)
What version of ArkOS are you on?
Newest "RGB30 | (Updated 10/16/2023) MD5:0C65C5C7D7CFEE353AE9FB30B42B2159"
Anything else you'd like to include that may help to review this issue or feature request?
Only making this ticket because this can literally add DAYS of extra scraping... Last night I added 1 single game to my NES rom folder... should have taken ~30 seconds to download the box art and video for that ONE single game... but instead took me ~8 HOURS to scrape my entire NES folder last night (~8K games... even have 7x threads on ScreenScraper.fr...).
Also to note: after this happened, I imaged a new version of ArkOS onto another SD card and this same issue persists. The ONLY things I did on the new setup was turn on WiFi, then tried this. I did not update the new install, but the old one DID have everything updated (which took around 2 hours, so assume it had newest everything).