Universal-Rom-Tools / Universal-XML-Scraper

Scraper de Rom
196 stars 46 forks source link

Missing File #159

Closed Universal-Rom-Tools closed 6 years ago

Universal-Rom-Tools commented 7 years ago

If you want to add some new Rom to the screenscraper DB,

just read this : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Rom-Missing-on-Screenscraper

runechronos commented 7 years ago

Hy, here is what i get with F-CRC Calculator for my Chrono_cross.iso and my Parasite_eve.iso (they are fan translated games in french, so obviously the hash does not match with the original game, but the name should)

Chrono_cross.iso                                                    92AFCE82      736 651 104    19:52.54 2015-02-08    2A6AE8DFEA00155D34C75E72EEC40BB6
Parasite_eve.iso                                                    59891049      496 497 792    11:26.12 2005-07-31    287001BE9A060D12410FF176F43EB2C8

They are not found by the scrapper yet they exist in Screenscraper and the games have all the images they need to be scraped.

What should I do ?

Universal-Rom-Tools commented 7 years ago

Added ;) (But I rename the Rom to match "standard" format : Chrono cross (U) [T Fre] and Parasite eve (U) [T Fre])

runechronos commented 7 years ago

Thanks :), do you want me to give you a list of translated roms, which you can add to the database as u just did ? Or is it best that I rename my roms to match the names already registered on screenscrapper ?

Universal-Rom-Tools commented 7 years ago

The best is to upgrade the DB ;) so you can send me new "missing" to add, just take care about the Name... (to have a nice DB ;) )

pillabichos commented 7 years ago

I'd like to add some Amstrad CPC games that there aren't in your database beause they are new developments. I try with F-CRC Calculator, now I send a few games and if this is the correct way I'll send more:

180 FutureOS-Installer_Konfig .8 - Spanish 2016-08-09.dsk C37BAFEB 194 816 15:10.17 2016-09-03 A2E748E244F30A5B569DEF8F3C319B29 180 FutureOS XROMs 2016-08-09.dsk 67F35D3B 194 816 15:10.22 2016-09-03 74A5245D3F3BD84F4BBF0C8EBB896D98 2015_che_cheesetea_zrealms._2015-07-27_010428.zip 47574518 834 536 14:59.35 2016-02-13 D98F60F5E5F684C8768DB6BB46A8E0A7 aalc2.zip 8469600B 45 092 06:27.55 2016-06-25 3209786F07DAD1D1DAC5B2B176121215 Adios_a_la_Casta-2-vs-1.0.zip E41FFA34 71 620 10:32.35 2016-10-30 D9CD7FD7C74E09285DBDE822626B3520 Adios-a-la-Casta-Episode-1.zip D43A4331 166 770 21:09.05 2016-09-29 891DF85769D8CD8B39C183F4DC540D12 antattack.dsk.zip C2E39850 27 740 11:15.09 2016-12-30 26CA90F1EB954C4F53FC1E11DA3A4B22 aqua.dsk.zip 3C0E9DC7 18 097 11:15.16 2016-12-30 153B4B97F513291D660CD147214851BC area51.dsk.zip 3D1D1CC2 6 585 11:15.22 2016-12-30 327A10A5562FB2DFFBD6F82B4CE50002 arquimedes-xxi.dsk.zip 64B6A626 75 951 11:14.13 2016-12-30 BB54D579987411AF7F22C6055F66E2B4 Atlantida3000_ams.zip 58E76378 40 706 10:15.47 2015-08-27 1C1B1BD2BBA0BBAB3D05728C53E3286D battro.zip 1794F5B0 33 445 07:46.10 2015-04-01 E12A9357D7BBD8DCCBFB0D298493BD18 castaway.zip D0856A07 254 377 12:26.35 2016-08-17 F597C0909C74C09D316BFEA9E38C4E06 Cero Absoluto (cdt).zip AA4C44FD 73 302 12:35.15 2016-09-10 87DA49E0B6804E4D7B893EA1C9FAC54B Cero Absoluto (dsk).zip 3099D238 65 891 12:35.09 2016-09-10 BA3EDD1780053CF0F82C405E644EA22F cheril.dsk.zip 684AD0FA 44 042 11:16.22 2016-12-30 D36796F6E7E7B90EBF20809E1B7EE331 citadelle.dsk.zip 98C49CCB 69 777 11:16.29 2016-12-30 A5B39A02627790953AF6C93D415372F3 CiudadelaFantasma_1992.zip C318E284 42 523 00:53.06 2016-03-18 8547A031D1CFED2F4AC8E52CB9C1F759 crazysnake.dsk ADEA3563 204 544 00:42.45 2015-03-01 E78CA49CD7A58D665CE45CF165E3C51F crystalmission.dsk B50DA604 194 816 00:42.51 2015-03-01 41B9B60DC338B26BA6789D967C160636 defence.zip AB4E0485 1 388 162 12:33.21 2016-09-10 C41B31CB789A2D97A528587EE1BFDD22 golden-tail.zip AE591E39 73 648 21:39.59 2016-08-05 3B1B2320B1BF712F70D8A21FC401991B HEROES RESCUE CPC.zip 92F63AAF 120 477 14:39.26 2016-12-11 32120B170360A5B822BA6894FD2E2850 HEROES RESCUE duo.zip 6EF06E29 30 295 14:39.45 2016-12-11 6BFEF4C7EDC19B757F986E27E33C2E59 Jewel Warehouse1.1.dsk.zip 43D36A6B 38 036 11:14.02 2016-12-30 8A1B65F8003B3FA5C80FA059AF484BD6 magica.zip 6ECA9B1F 101 586 07:18.54 2016-11-13 2A239573680AAA05420EF59FA3104BAF Megablasters - Escape from Castle in the Clouds.zip 7D8EF1F3 111 241 22:56.25 2015-02-02 18C0E05E9D541F401737DCE4AB79F48E Mojon-Twins--Cheril-of-the-Bosque--CPC-DSK.zip 3E12FEA5 46 730 11:34.51 2016-04-17 856F77035371D6C534D883461E2D303F Mojon-Twins--Nanako-Descends-To-Hell--CPC.dsk.zip 0EEBEF32 35 150 11:10.17 2016-12-30 285707092217D7F4FD49737BD9D44B48 Mojon-Twins--Nanako-Descends-To-Hell--ZX.tzx.zip 85864075 30 070 11:10.29 2016-12-30 83F66EF34FDE6AF0269D7C3906022589 Mojon-Twins--Nanako-In-Classic-Japanese-Monster-Castle--CPC.cdt.zip D5146187 22 130 11:16.57 2016-12-30 A0644ADC81D605C0946462DCB5A5C560 Mojon-Twins--Nanako-In-Classic-Japanese-Monster-Castle--CPC.dsk.zip 07D1F026 42 421 11:17.04 2016-12-30 9E13BC51B1848F52635EB9E68245107E Mojon-Twins--Platformer-Medley--block-1_cdt_by_SyX.zip 4FE8A7FF 24 802 21:53.16 2016-07-08 C1E433CC9E04429645B71BF27C59C429 Mojon-Twins--Platformer-Medley--block-1--dsk.rar 86707D01 29 884 21:53.05 2016-07-08 1BEC8B23B6995623482C5A93DD62349C Mojon-Twins--Uwol-2--CPC.dsk.zip ECA4A6A8 36 551 10:59.37 2016-12-30 C73C95DB6C17B985700B1593CAAFB1E0 Outlaws - Disc.dsk 0A12E714 204 544 19:40.37 2016-11-07 8B05BD55176D505E07E6D34391A1295E Outlaws - Tape Normal Load.cdt 30C3A1A5 53 381 19:41.25 2016-11-07 B90CF0CEF89FCE212C55346BE1611D14 Pac-Man_v1.01_con_roms.dsk.zip B05C835E 116 928 09:09.46 2015-09-07 EA24CAED402DA9557558E52837997815 phoenix.dsk.zip 9A66456D 20 942 10:58.58 2016-12-30 B426C6A2FE448114B0CFC9AFF6FC12F3 pinballdreams_preview.zip 68C42A23 124 440 21:57.41 2016-10-27 234BF3D735C2FB3F7A39352862E1A860 PreludeToChaosCPC.zip 68B439D2 68 294 22:55.35 2016-03-22 E47DA353FD551ECB94D84B8408326A45 sardina4ever_cdt.zip 6FCBBE69 28 490 20:28.15 2016-04-04 4F0EFB197F86B32B7F96D175F3D7FE25 sardina4ever_dsk.zip A6FA0B83 30 311 20:28.07 2016-04-04 7E70CEE40B92C42723E7D92457F80132 traxtor2-cpc.zip B71CE9D5 31 057 21:00.52 2015-11-27 AEBB4B445EFA9A131797EB586FF7689E Vector Vaults.zip 5752F342 79 532 06:03.53 2016-09-29 51AAE3151500F7C5BDA01D0BF642C087 ZapTBallAdvEdi.zip 5EEE3C4E 252 027 07:12.23 2016-01-24 EAFA854842D24439F991D7F9EB1B407A

paradadf commented 7 years ago

@pillabichos please, upload the file and don't just do a copy&paste of its content here, because the format is important and github (and other forums) change it.

pillabichos commented 7 years ago

My F-CRC Calculator log file I upload it to google drive because github doesn't allow me to upload this kind of file.

paradadf commented 7 years ago

@pillabichos are those official names? I see 1... 2... etc, and that seems weird.

pillabichos commented 7 years ago

All these files are in ftp://amstrad:amstrad@amstrad.serveftp.com/incoming/homebrew without modifications and with these names. The files with name starting with number are from CPCRetroDev'15 Quiz, the numbers are the position in the quiz.

paradadf commented 7 years ago

@pillabichos the list was imo a bit dirty, so I cleaned it up. There were at least two ZX Spectrum games there, so I took them out. Also the game CiudadelaFantasma_1992.zip is corrupt on the website (you can't unzip it), thus I'm not adding it. I decompressed everything and left only the .dsk files, which are properly named. UXS look inside the zip file if the hash of the zip if isn't found, so there should be no problem there. The zip files were full of images, pdfs, and more other crap. sselph's scraper does only look inside the zip, so that works too. The clean log is here:

F-CRC AMSTRAND CPC

But I'll ask @Universal-Rom-Tools to add those just to be sure what I did is correct.

giventofly commented 7 years ago

well, i did a new passage to update missing roms and some of the games were now found, will do an update soon (deleted my previous message).

Universal-Rom-Tools commented 7 years ago

Just Added the Cleaned File From Paradadf...

http://pastebin.com/wHbLUWdD

Now you need to associate rom to game ;)

Viitis commented 7 years ago

_Lynx_missing.txt _Nintendo 64_missing.txt

Universal-Rom-Tools commented 7 years ago

Done @Viitis ;)

chiribas10 commented 7 years ago

Hey. Here is my file for the Sega Mega Drive (Sega Genesis) _Megadrive_missing.txt

giventofly commented 7 years ago

_Super Nintendo_missing.txt

super nintendo

Universal-Rom-Tools commented 7 years ago

@chiribas10 It's done ;)

@giventofly Sorry, your roms weren't well named (the Country info is missing like (U) or [J] tag...) I can't import your missing :(

giventofly commented 7 years ago

all right, i will download new roms.

btw, i don't know why one game from dreamcast isn't scrapping nor is appearing on the missing list, should i open an issue?

Universal-Rom-Tools commented 7 years ago

Great for the new romset (try No-Intro ;) )

for the DC game, yes, create an Issue I'll look when I can (sorry, little busy these last time...)

paradadf commented 7 years ago

@giventofly for the DC game, you can look for the rom itself on the database. It is probably there and hasn't been associated yet or it is associated but has no data.

giventofly commented 7 years ago

_PC Engine_missing.txt _Playstation_missing.txt _Megadrive_missing.txt _NES_missing.txt

_Dreamcast_missing.txt

the nointro roms really helped a lot :) here are the only ones missing

stamstams commented 7 years ago

Hello, 2 games seem to be missing from the Playstation 1 database, please have a look.

http://pastebin.com/3rnv7Zxn

https://en.wikipedia.org/wiki/DoDonPachi https://en.wikipedia.org/wiki/One_(video_game)

Thanks.

pillabichos commented 7 years ago

CPCRetroDev'16 - Amstrad CPC Roms. CPCRetroDev'14 - Amstrad CPC Roms.

Thanks!

bibi32 commented 7 years ago

_Game Boy Advance_missing.txt _Lynx_missing.txt _Mame_missing (neogeo).txt _Megadrive 32X_missing.txt _NES_missing.txt _Nintendo 64_missing.txt _PSP_missing.txt _Super Nintendo_missing.txt

Certains jeux n'apparaissent pas dans les fichiers missing et ne sont pas scrappé.

Frohl commented 7 years ago

_Super Nintendo_missing.txt _Megadrive_missing.txt _Nintendo 64_missing.txt

Those are the roms i'm missing right now. Pulled straight from No-Intro without changing file names Thanks

Universal-Rom-Tools commented 7 years ago

@giventofly PC Engine : Done Playstation : Sorry, no info on the file name about the Rom country Megadrive : All already exist in DB, I think they are orphean and waiting to you to be associated ;) NES : The same, all are already in DB... Dreamcast : CRC32 missing... Can you try with F-CRC (https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Rom-Missing-on-Screenscraper)

@stamstams PSX : MD5 missing... Can you try with F-CRC (https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Rom-Missing-on-Screenscraper)

@pillabichos CPC : All done, but must be associated now ;)

@bibi32 GBA : done Lynx : not a game :( Neogeo : done 32X : done N64 : done PSP : CRC32 missing... Can you try with F-CRC (https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Rom-Missing-on-Screenscraper) SNES : done

@Frohl SNES : All already exist in DB, I think they are orphean and waiting to you to be associated ;) Megadrive : The same, all are already in DB... N64 : The same, all are already in DB...

Thank you every one, contributing to the DB. Sorry for the file I can't import. And for info, when I say : "done", some rom are autoassociated to there respective game, but some still in orphean waiting you to associate them.

bibi32 commented 7 years ago

_Atari ST_missing.txt _Game & Watch_missing.txt _Mame_missing (fba).txt _MSX_missing.txt _PC Engine SuperGrafx_missing.txt _WonderSwan Color_missing.txt

Missing NES from my last post.

giventofly commented 7 years ago

will check the other ones, here is the one for dreamcast: http://pastebin.com/v5gb0dFg

bibi32 commented 7 years ago

_Neo-Geo Pocket Color_missing.txt _Neo-Geo Pocket_missing.txt _ScummVM_missing.txt

bibi32 commented 7 years ago

_PSP_missing.txt

Done with F-CRC

Universal-Rom-Tools commented 7 years ago

@bibi32 : Atari ST : Done G&W : Done Mame : Done (except : sfiii3a.zip -> No CRC) MSX : Name aren't "normalized" sorry I can't import them (Try to look for Tosec ;) ) PC_Engine : Except Reflectron all other Rom where already in the DB WSC : Done NGPC : Done (FYI : PD aren't handled right now by the Screenscraper Staff, In fact, we have enough job with official Game to take PD in charge... So I imported your rom, but none of them, or very few, are already exist as a Game... If you want them to be scraped, take some friend ;) and work on it ^^... The team will validate what you submit, but won't create any media or info on them ;) ) NGP : Done Scummvm : Sorry Impossible to import that.... Scummvm is really "particular", I can import only *.scummvm file... And (normally) they are already all in the DB.... PSP : Done

@giventofly Dreamcast : Done

giventofly commented 7 years ago

~The dreamcast games did not scrap (and no orpheans)

EtherBoo commented 7 years ago

_Dreamcast_missing.txt Here are some missing ones from Dreamcast.

Universal-Rom-Tools commented 7 years ago

@EtherBoo : DC : CRC32 missing... Can you try with F-CRC (https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/Rom-Missing-on-Screenscraper)

@giventofly : Rom are associated, can you try : https://github.com/Universal-Rom-Tools/Universal-XML-Scraper/wiki/ISO-Scrape-Freeze-or-are-very-long

stamstams commented 7 years ago

Hello, Here are the isos with the mD5 http://pastebin.com/4jVX3YNE

But it doesn't change the fact that these games aren't in the database :)

abunille commented 7 years ago

EDIT: delete Link Thank you

giventofly commented 7 years ago

.chd ? are they readable by the emulator?

abunille commented 7 years ago

yes

giventofly commented 7 years ago

i don't find it on the website http://www.recalbox.com/ what is the emulator? (recallbox before editing)

abunille commented 7 years ago

Yes, thats right because its no stable release. Im on 4.1 "unstable". I think the emulator is "Reicast", but im not sure at the moment.

Here you can read about news and how to update to 4.1 unstable: http://www.recalbox.com/blog

es_systems.cfg at master: https://github.com/recalbox/recalbox-buildroot/blob/master/board/recalbox/fsoverlay/recalbox/share_init/system/.emulationstation/es_systems.cfg

EDIT: this is the wrong place to write about it ;)

giventofly commented 7 years ago

was hoping it could be another emulator running on raspberry pi so i could try dynamite duke :P

bibi32 commented 7 years ago

_Mame_missing.txt neogeo

azvarel commented 7 years ago

_Mega-CD_missing.txt

azvarel commented 7 years ago

_Playstation_missing.txt

Genetik57 commented 7 years ago

_Playstation_missing.txt

EtherBoo commented 7 years ago

@Universal-Rom-Tools DC1.txt

Sorry for the delay, here's the F-CRC32 file.

pillemats commented 7 years ago

hey

please add the following dreamcast crc/md5 files to the db. so i can scrap the files

not all in the list will be find by uxs

it will be all no into roms

is it possible ?

Thanks

or is it enough to upload the missing.txt ? From when I can expect to start the uxs again

here they are

_Master System_missing.txt _Super Nintendo_missing.txt _Megadrive_missing.txt _Game Boy_missing.txt _Game Gear_missing.txt Dreamcast CRC.txt _Playstation_missing.txt _Nintendo 64_missing.txt _Game Boy Color_missing.txt _Dreamcast_missing.txt _PSP_missing.txt _NES_missing.txt _Game Boy Advance_missing.txt

Universal-Rom-Tools commented 7 years ago

@stamstams PSX OK

@abunille Sorry stand by on chd file... can we talk about it on IRC ?

@bibi32 Neogeo OK (need to be associated)

@azvarel Sorry, none of your iso have "tag" in their name... It will be verry hard for us to set the country (for exemple) of these file... And we need it.. have you renamed these file ? Same on you PSX file... Can you tell me where they are from (no link here, contact me on IRC ;))

@Genetik57 Only croc2 (cue file) have been added... The other already exist or haven't MD5

@EtherBoo Dreamcast OK

@pillemats MS : All already exist SNES : same Megadrive : Same Gameboy : nearly the same (some are imported, but a very few) GG : All already exist DC : You forgot to check the MD5 checkbox :( I can't import them (and there are no CRC on the other file) PSX : no CRC.. I can't import them n64 : All already exist GBC : nearly the same (some are imported, but a very few) PSP : no CRC.. I can't import them GBA : All already exist I think you have a problem on your PC... Try not to scrape a sunday (server is overloaded) and create an account on Screenscraper Website to not be rejected when server overload..

Thank you guys.. And sorry to be late ;) I were working on UXS V2.2 ;) it's released now ;)

pillemats commented 7 years ago

Thank you very much for your reply

with the new uxs have been performed much more games than before but not all.

i have scraped all systems at once but now the missing file is emty in all systems but he has not found all games.... excepting dreamcast, there are few games in the he file....

thats curios.... do you know what should i do now ?

EDIT: But i just noticed that the uxs not shutting down recalbox but still he scrapes..... is it normal ?

i am using the odroid xu4

Universal-Rom-Tools commented 7 years ago

@pillemats please make an other issue for that ;)