search

sselph / scraper

A scraper for EmulationStation written in Go using hashing
MIT License
448 stars 88 forks source link

Innerworkings #231

Open truhlikfredy opened 6 years ago

truhlikfredy commented 6 years ago

Great tool, but I'm struggling with few things.

How actually some of the inner workings operate? I want to calculate hash without running scraper, but can't the md5,sha and others do not match your results.

Then hash.csv colum 3 is not explained, is that platform? would some table/wiki with explanations possible?

truhlikfredy commented 6 years ago

I mean there is https://github.com/sselph/scraper/wiki/Using-your-own-images and https://github.com/sselph/scraper/issues/104

but can't find table what sysmtem_id is what system

sselph commented 6 years ago

Sorry I sent this response at lunch via email but github never posted it so will just do it myself. If there is a similar update later, I apologize.

The platform ID was from the following. I don't think I use it for much more than sorting the CSV while working on it. http://legacy.thegamesdb.net/api/GetPlatformsList.php

To calculate the hash without running the scraper, I created https://github.com/sselph/scraper/tree/master/shasum that just loads the info for computing the sha1. It works similar to the standard shasum utility. It could easily be modified to compute other hashes if needed. Depending on the system hashes won't match a standard shasum because the code removes headers and swaps bytes around to get a consistent format to match No-Intro.