Scraping crashes

[GoogleCodeExporter]

What steps will reproduce the problem?
1. Add a new ROM Collection (SNES in my case), using the default rom folder and 
the default online scrapers.
2. Start scraping. It can take several hours.
3. After a while (let's say after scraping around 2000 ROMS), RCB crashes, and 
the screen goes back to XBMC's main menu.
4. If you try to rescrape the same rom collection, it starts over again, with 
the same results. No additional roms are scraped.

What is the expected output? What do you see instead?
- Scraping finishes after a while, and the list of games that had been scraped 
appear on RCB. It should finish scraping all the games in the subfolders, but 
instead it crashes and only scans the first 2000 games (give or take).

What version of the product are you using? On what operating system?
- Version 2.0.10, on Xbian 1.0RC1 (Raspberry pi)

Please provide any additional information below.
- I am trying to scrape a full SNES romset, which may consist of 12000 games or 
more. At first they were all in the same folder, but now I created a subfolder 
for each starting letter in order to reduce the number of roms in a single 
folder. RCB wasn't affected by this change.

Original issue reported on code.google.com by marcpal...@gmail.com on 3 Feb 2014 at 8:39

[GoogleCodeExporter]

I tried deleting many of the roms, so my collection now "only" has like 2100 
games, and it seems that the scraping reached the end of the list. However, on 
certain ocasions RCB would crash and bring you back to XBMC's main menu 
(sometimes after restarting the whole xbmc).

Original comment by marcpal...@gmail.com on 23 May 2014 at 7:58

[GoogleCodeExporter]

Does this error still happen during scraping or just when you load RCB?
Can you show me a log file?

Original comment by maloep on 23 May 2014 at 11:42

• Changed state: Accepted

[GoogleCodeExporter]

What used to happen when I had so many roms for a rom collection, is that I 
would let it scrape overnight and the next day I would find XBMC at the main 
screen. It wasn't until recently that I saw that during scraping (I installed a 
vnc server so I can monitor the progress more closely) it would crash and 
restart the whole XBMC, instead of just closing RCB. I can confirm that it 
still happens because I saw it yesterday while scraping SNES games, after it 
had scraped the first 1500 games or so. 

It never happens when loading RCB, I never had a problem at that point.

I have the log files, but they are huge and I'm unable to locate this specific 
event (and it's difficult to replicate...) But I'll try to be aware the next 
time it happens to paste you the log file.

Original comment by marcpal...@gmail.com on 23 May 2014 at 1:06