Aloshi / EmulationStation

A flexible emulator front-end supporting keyboardless navigation and custom system themes.
MIT License
2.05k stars 903 forks source link

Scraper #fails - http request error, or start-end tags mismatch #450

Open jandrioli opened 9 years ago

jandrioli commented 9 years ago

Hi, After trying to run emulationstation under Retropie on the raspberry pi I decided to go brute and install on a spare laptop I have almost dumped a while ago.

Compiled from sources, but I am not sure I am running the unstable branch because my checkout was like this: [code] $ git clone {url}; cd EmulationStation; git checkout unstable;[/code] But after the last checkout nothing actually happened, no pulls, nada. Anyway my problem with the scraper is that I just can't get any game scraped. I have only SNES configured, and I have hundreds of roms. The messages I get on console are:

lvl0:   GamesDBRequest - Error parsing XML. 
    Start-end tags mismatch
lvl0:   ScraperHttpRequest network error (status: 2) - Couldn't connect to server

And this is when I try the 2 first scrapers thegamedb and thearchive. When I ran this scraper on the rpi it did not fail. Maybe someone committed bad code? Help? Thanks. BTW some developer out there, can you tell me the dev environment you use for this project? Eclipse?

saintbarra commented 8 years ago

Having the same / Similar issue on a windows 10 pc. Scraper worked the first time I booted emulation station. then the second time and every other time after I was unable to scrape any games.

its strange that the scraper worked the first time and now it wont work at all

my error code. lvl0: GamesDBRequest - Error parsing XML. Start-end tags mismatch lvl0: GamesDBRequest - Error parsing XML. Start-end tags mismatch

I don't have this problem with a retropi. it seems to be a windows issue

Searched all over the net for a solution. I will keep digging through the code and see if I can find a solution. Hopfully someone out there will be able to help.

jurf commented 8 years ago

Not a windows issue, I have the same on Arch Linux.

saintbarra commented 8 years ago

Hello Doctor jellyface

Its intersting that you are getting the same error with the scraper using Arch and LInux. This rules out my theory that its a windows issue.

I have a few questions for you

  1. Are you getting the same error code that i am getting?
  2. Have you done anything to trouble shoot your scraper issue? If so what did you find?
  3. Did the Scraper work on your Arch and Linux builds on the first boot of Emulationstation ?
  4. Are you using Retroarch as your backend?
  5. Are you using a raspberry pi ir a pc/laptop?

Hopfully we can work this one out. I will have another play with the sysfiles tonight.

Good luck

jurf commented 8 years ago

using Arch and LInux

Hehe, it's just Archlinux.

  1. Yes.
  2. Seems as ES includes old code which isn't compatible with the new XML layout. You can try checking out this script. I didn't get it to run due to some weird python dependency issues (I haven't quite got my head around how they work), but you can try it yourself.
  3. Didn't try, doubt it's relevant.
  4. Yes, shouldn't be relevant either, it has nothing to do with scraping.
  5. Laptop, x86_64.

I'm not really optimistic about getting this to work, I even tried RetroPie's version, no luck. Best chance is to follow Herdinger's fork and see if they fixed it. I'll try pinging them about the issue.

joolswills commented 8 years ago

thegamesdb.net is currently offline - maybe it was just having trouble when you tried ?

joolswills commented 8 years ago

the original post is clearly a networking problem (site is down, or something else)

jurf commented 8 years ago

Oh, you're right, it is down. Looks like the start-end tag error is caused by the Cloudfare page. However when trying THEARCHIVE, ES freezes. Weird.

jurf commented 8 years ago

Well, at least The Games DB is now aware of the issue.