Any hope to add the roms that are on cylum's romsets but not on the everdrive packs.

[ghost]

They need to be added before nintendo takes them down. https://drive.google.com/drive/folders/0B1VEYI5Xz677UjM4bEtTektJRFk

[maniac79]

@frederic-mahe: Do you want to have ROMs added from the Cylum set? I am not sure but believe this is mainly about hacks, which can be a PITA to maintain going forward if they get updates, etc... If yes, you can assign this to me but I'd appreciate to get more information from the requester which ROMs are supposedly missing.

@ghost: Can you please specify which ROMs exactly you think should be added in case Frederic's response is positive?

[frederic-mahe]

I did a rapid test with Cylum's Famicom hacks, using their SHA256 hashes as search key. A large portion of the hacks are not in the N8 SMDB (see the list below).

It seems that merging the Cylum sets will be a major endeavor. Maybe we should first focus our efforts on fixing the SMDBs and getting in sync with No-Intro? What do you think @maniac79 ?

./Captain America - The Winter Soldier/Captain America - The Winter Soldier (Power Blade 2 modification) (1.1).nes
./Cosmic Balloon Assault/Cosmic Balloon Assault (Balloon Fight modification) (1.0).nes
./Tecmo Super Bowl 2014/Tecmo Super Bowl 2014 (Tecmo Super Bowl modification) (1.0a).nes
./Super Mario Fantasy Adventure/Super Mario Fantasy Adventure (Final Fantasy modification) (1.2).nes
./Super Mario Bros. 3 - Crowned Edition/Super Mario Bros. 3 - Crowned Edition (Super Mario Bros. 3 modification) (1.0).nes
./Tecmo Super Bowl 2017/Tecmo Super Bowl 2017 (Tecmo Super Bowl modification) (Rev-2).nes
./Contra (Hardest Mode)/Contra - Hardest Mode (Contra modification) (1.0).nes
./Super Smash Bros/Super Smash Bros. (Nekketsu Kakutou Densetsu modification) (1.0).nes
./Roll-chan no Constancy/Roll-chan no Constancy (Mega Man 2 modification) (1.1).nes
./Solomon's Key - Unlocked/Solomon's Key - Unlocked (Solomon's Key modification) (1.0).nes
./Legend of Zelda, The - Trial of Courage/Legend of Zelda, The - Trial of Courage (The Legend of Zelda modification) (1.6).nes
./Crow, The/Crow, The (Batman - The Video Game modification) (1.0).nes
./Ultima III - A New Exodus/Ultima III - A New Exodus (Ultima III - Exodus modification) (1.0).nes
./Dragon Quest (Mobile Script Port and Relocalization) (1.3c).nes
./Castlevania (Improved Controls)/Castlevania - Improved Controls (Castlevania modification) (1.1).nes
./Darkwing Duck (New Levels)/Disney's Darkwing Duck - New Levels (Disney's Darkwing Duck modification) (1.0).nes
./Legend of Zelda, The - The Wrath of Ganon/Legend of Zelda, The - The Wrath of Ganon (The Legend of Zelda modification) (1.2).nes
./Hydlide (Rebalanced)/Hydlide - Rebalanced (Hydlide modification) (1.0).nes
./Castlevania V - Legacy/Castlevania V - Legacy (Castlevania modification) (1.0) (Improved graphics).nes
./NCAA Football 2020/NCAA Football 2020 (Tecmo Super Bowl modification) (1.0).nes
./Tecmo Super Bowl 2013/Tecmo Super Bowl 2013 (Tecmo Super Bowl modification) (Preseason).nes
./Blaster Master - Metafight Alpha/Blaster Master - Metafight Alpha (Blaster Master modification) (1.0).nes
./Mario Kart/Mario Kart (R.C. Pro-Am modification) (1.0).nes
./Battle City Mario/Battle City Mario (Battle City modification) (1.0).nes
./Castlevania III - Curse of the Moon/Castlevania III - Curse of the Moon (Castlevania III - Dracula's Curse modification) (1.3).nes
./Kirby's Halloween Adventure/Kirby's Halloween Adventure (Kirby's Adventure modification) (1.1).nes
./NCAA Football 2016/NCAA Football 2016 (Tecmo Super Bowl modification) (1.0).nes
./Pop Star Debut/Pop Star Debut (Idol Hakkenden relocalization) (1.0).nes
./Legend of Zelda, The - Outlands/Legend of Zelda, The - Outlands (The Legend of Zelda modification) (1.0).nes
./Bomberman Starring Pretty Bomber/Bomberman Starring Pretty Bomber (Bomberman modification) (1.1.0).nes
./Zelda II - The Triforce of Courage/Zelda II - The Triforce of Courage (Zelda II - The Adventure of Link modification) (1.1).nes
./Rockman no Constancy/Rockman no Constancy (Mega Man 2 modification) (1.3).nes
./Castlevania III - Dracula's Curse (Retranslation and Improved Controls)/Castlevania III - Dracula's Curse - Retranslation and Improved Controls (Castlevania III - Dracula's Curse modification) (7.1 & 1.4).nes
./Balloon Fight (Four-player)/Balloon Fight - Four-player (Balloon Fight modification) (1.1).nes
./Contra - Red Falcon War/Contra - Red Falcon War (Contra modification) (2.1).nes
./Superman/Superman (Sunman modification) (1.0).nes
./Final Fantasy Negative One/Final Fantasy Negative One (Final Fantasy modification) (2.0).nes
./Crystalis (Rebalanced)/Crystalis - Rebalanced (Crystalis modification) (Final).nes
./Street Fighter II (Improvement)/Street Fighter II - Improvement (Street Fighter III modification) (1.0).nes
./Ultima III - Exodus Remastered/Ultima III - Exodus Remastered (Ultima III - Exodus modification) (1.03) (Adjusted font).nes
./Super Mario World (Improvement)/Super Mario World - Improvement (Super Mario World modification) (1.0) (New blocks).nes
./Second Ultimate Bugs Bunny Crazy Castle, The/Second Ultimate Bugs Bunny Crazy Castle, The (The Bugs Bunny Crazy Castle modification) (1.0).nes
./Mighty Morphin Power Rangers/Mighty Morphin Power Rangers (Kyouryuu Sentai Zyuranger relocalization) (1.0).nes
./Metroid Incursion/Metroid Incursion (Metroid modification) (1.1) (Mini map + save feature).nes
./Rockman 4 - Minus Infinity/Rockman 4 - Minus Infinity (Mega Man 4 modification) (1.0).nes
./Legend of Zelda, The - Triforce Power/Legend of Zelda, The - Triforce Power (The Legend of Zelda modification) (3.2).nes
./Castlevania II - Simon's Quest (Redaction+)/Castlevania II - Simon's Quest - Redaction+ (Castlevania II - Simon's Quest modification) (1.0) (Hearts, floors & transition fixes).nes
./Pooyan (Enhancement)/Pooyan - Enhancement (Pooyan modification) (1.0).nes
./Rambo - First Blood Part II/Rambo - First Blood Part II (P.O.W. - Prisoners of War modification) (1.0).nes
./Jackal 2/Jackal 2 (Jackal modification) (2.1).nes
./Bomberman (Two-player)/Bomberman - Two-player (Bomberman modification) (1.02).nes
./Super Contra HD/Super Contra HD (Super C modification) (Final).nes
./Legend of Zelda, The - Winter Solstice/Legend of Zelda, The - Winter Solstice (Zelda II - The Adventure of Link modification) (1.1).nes
./Super Luigi Bros. 3/Super Luigi Bros. 3 (Super Mario Bros. 3 modification) (1.0).nes
./Pac-Man Xtreme/Pac-Man Xtreme (Ms. Pac-Man modification) (1.0).nes
./Ninja Gaiden III - The Ancient Ship of Doom (Restoration)/Ninja Gaiden III - The Ancient Ship of Doom - Restoration (Ninja Gaiden III - The Ancient Ship of Doom modification) (1.0).nes
./Castlevania III - Dracula's Curse (Linear version)/Castlevania III - Dracula's Curse - Linear version (Castlevania III - Dracula's Curse modification) (1.0).nes
./Tecmo Super Bowl 2020/Tecmo Super Bowl 2020 (Tecmo Super Bowl modification) (Rev-2).nes
./Legend of Zelda DX, The/Legend of Zelda DX, The (The Legend of Zelda modification) (1.0).nes
./Rockman 5 - Double Jumper/Rockman 5 - Double Jumper (Mega Man 5 modification) (2.0).nes
./Real Ghostbusters Remastered, The/Real Ghostbusters Remastered, The (Ghostbusters modification) (1.1).nes
./Go-Go! Ice Challenge Ultimate!/Go-Go! Ice Challenge Ultimate! (Ike Ike! Nekketsu Hockey-bu - Subette Koronde Dairantou modification) (1.0).nes
./Lode Runner Blue/Lode Runner Blue (Lode Runner modification) (1.0).nes
./Battle City (Four-player)/Battle City - Four-player (Battle City modification) (Added options) (1.3).nes
./WWE Wrestling/WWE Wrestling (Pro Wrestling modification) (2.0).nes
./Ninja Gaiden - Dragon Scroll/Ninja Gaiden - Dragon Scroll (Ninja Gaiden modification) (1.0).nes
./Legend of Zelda, The - Return of Ganon/Legend of Zelda, The - Return of Ganon (The Legend of Zelda modification) (1.0).nes
./Bowser Jr/Bowser Jr. (Donkey Kong Jr. modification) (1.0).nes
./Final Fight 3 Deluxe/Final Fight 3 Deluxe (Final Fight 3 modification) (1.0).nes
./P.O.W. - Prisoners of War (Two-player)/P.O.W. - Prisoners of War - Two-player (P.O.W. - Prisoners of War modification) (1.5a).nes
./Metroid - Dark Alliance/Metroid - Dark Alliance (Blaster Master modification) (2.0).nes
./Super Mario Bros. DX/Super Mario Bros. DX (Super Mario Bros. modification) (3.4).nes
./Blaster Master (Quadrant)/Blaster Master - Quadrant (Blaster Master modification) (1.3).nes
./Tecmo Super Bowl 2019/Tecmo Super Bowl 2019 (Tecmo Super Bowl modification) (Rev-1).nes
./M-Tee's Box Art Bomberman/M-Tee's Box Art Bomberman (Bomberman modification) (1.1) (Co-op).nes
./Super Bubble Bros/Super Bubble Bros. (Super Mario Bros. modification) (2.0).nes
./Contra Aoi Version/Contra Aoi Version (Contra modification) (1.8).nes
./Contra - Revenge of the Red Falcon/Contra - Revenge of the Red Falcon (Contra modification) (1.0).nes
./God of War II/God of War II (Castlevania modification) (1.0).nes
./Tecmo Super Bowl 2018/Tecmo Super Bowl 2018 (Tecmo Super Bowl modification) (1.0).nes
./Chip 'n Dale Rescue Rangers 2 (Four-player)/Disney's Chip 'n Dale Rescue Rangers 2 - Four-player (Disney's Chip 'n Dale Rescue Rangers 2 modification) (3.0 3stag).nes
./Rockman 4 - Sparking to Hero/Rockman 4 - Sparking to Hero (Mega Man 4 modification) (1.0).nes
./Terminator, The/Terminator, The (Journey to Silius modification) (3.0).nes
./Castlevania II - Simon's Quest (Rev Edition)/Castlevania II - Simon's Quest - Rev Edition (Castlevania II - Simon's Quest modification) (1.0).nes
./NCAA Football 2019/NCAA Football 2019 (Tecmo Super Bowl modification) (1.0).nes
./Final Fantasy (Restoration)/Final Fantasy - Restoration (Final Fantasy modification) (1.11) (2019 script port + Debalance).nes
./Contra - Mountain Challenge/Contra - Mountain Challenge (Contra modification) (1.0).nes
./Mega Man CX/Mega Man CX (Mega Man 2 modification) (1.1).nes
./Ultimate Castlevania (Improved Controls)/Ultimate Castlevania - Improved Controls (Castlevania modification) (1.1).nes
./Adventure (NES Graphics)/Adventure - NES Graphics (Fanmade modification) (1.0).nes
./Goonies II, The (Revised Design)/Goonies II, The - Revised Design (The Goonies II modification) (1.0).nes
./Quest of Ki+, The/Quest of Ki+, The (Kai no Bouken - The Quest of Ki modification) (2.0).nes
./Halloween/Halloween (Friday the 13th modification) (1.0).nes
./Jackal - War Safari/Jackal - War Safari (Jackal modification) (1.0).nes
./Quest of Lala, The/Quest of Lala, The (Adventures of Lolo modification) (1.1).nes
./Impact Wrestling/Impact Wrestling (Pro Wrestling modification) (2.0).nes
./Castlevania II - Simon's Quest (Redaction)/Castlevania II - Simon's Quest - Redaction (Castlevania II - Simon's Quest modification) (1.0).nes
./Mr. Gimmick 2 - Shadow's Revenge/Mr. Gimmick 2 - Shadow's Revenge (Mr. Gimmick modification) (1.0).nes
./Super Mario All-Stars/Super Mario All-Stars (Super Mario Bros. 3 modification) (2-22-20).nes
./Mega Man 3 (Improvement)/Mega Man 3 - Improvement (Mega Man 3 modification) (2.1).nes
./Angry Birds/Angry Birds (Moai-kun modification) (1.0).nes
./New Ghostbusters II Plus/New Ghostbusters II Plus (New Ghostbusters II modification) (1.1).nes
./WWE Women's Revolution/WWE Women's Revolution (Pro Wrestling modification) (1.0).nes
./Tecmo Super Bowl 2016/Tecmo Super Bowl 2016 (Tecmo Super Bowl modification) (Rev-D).nes
./AEW Wrestling/AEW Wrestling (Pro Wrestling modification) (1.0).nes
./Castlevania - The Holy Relics (Improved Controls)/Castlevania - The Holy Relics - Improved Controls (Castlevania modification) (1.0).nes
./Tecmo Super Bowl 2015/Tecmo Super Bowl 2015 (Tecmo Super Bowl modification) (1.0a).nes
./Dragoon X Omega II/Dragoon X Omega II (Final Fantasy modification) (Final 2).nes
./God of War/God of War (Rygar modification) (1.2).nes
./Dragon Quest Heroes/Dragon Quest Heroes (Gauntlet modification) (1.0).nes
./Final Fantasy Redux/Final Fantasy Redux (Final Fantasy modification) (1.0.0).nes
./Luigi Bros/Luigi Bros. (Mario Bros. modification) (1.1).nes
./Super Mario Bros. 3 - A New Journey/Super Mario Bros. 3 - A New Journey (Super Mario Bros. 3 modification) (1.1).nes
./Castlevania II - Simon's Quest (Retranslation)/Castlevania II - Simon's Quest - Retranslation (Castlevania II - Simon's Quest modification) (2.9.8.19).nes
./Final Fantasy Ultra - Champion Edition/Final Fantasy Ultra - Champion Edition (Final Fantasy modification) (1.1).nes
./Castlevania II - Simon's Quest (Improved Controls)/Castlevania II - Simon's Quest - Improved Controls (Castlevania II - Simon's Quest modification) (1.3) (Retranslation).nes
./Rockman - Spirits of Hackers/Rockman - Spirits of Hackers (Mega Man 6 modification) (1.0).nes
./Coin Quest Starring Mario & Luigi/Coin Quest Starring Mario & Luigi (Super Uwol! Starring Uwol & Meemaid) (1.0).nes
./Big Trouble in Little China DX/Big Trouble in Little China DX (Bad Dudes modification) (1.0).nes
./Rick and Morty/Rick and Morty (Alien Syndrome modification) (1.1) (Skin color fix).nes
./Super Mario Unlimited/Super Mario Unlimited (Super Mario Bros. modification) (0.998).nes
./Zelda II - The Adventure of Link (Rev Edition)/Zelda II - The Adventure of Link - Rev Edition (Zelda II - The Adventure of Link modification) (1.6).nes
./Legend of Zelda, The - Awakening of Onox/Legend of Zelda, The - Awakening of Onox (The Legend of Zelda modification) (1.0).nes
./Super Mario Bros. 3 (Extended Edition)/Super Mario Bros. 3 - Extended Edition (Super Mario Bros. 3 modification) (Rev-A).nes
./Cobra Kai/Cobra Kai (The Karate Kid modification) (1.0).nes
./Mother - 25th Anniversary Edition/Mother - 25th Anniversary Edition (Mother modification) (1.11).nes
./Mega Man 4 Voyage/Mega Man 4 Voyage (Mega Man 4 modification) (1.06).nes
./Blaster Master (Savanna)/Blaster Master - Savanna (Blaster Master modification) (1.7).nes
./Ice Climber (Four-player)/Ice Climber - Four-player (Ice Climber modification) (2.0).nes
./Castlevania - Horror of Dracula/Castlevania - Horror of Dracula (Castlevania modification) (2.2).nes
./Sherlock/Sherlock (Batman - The Video Game modification) (1.0).nes
./Final Fantasy III Redux/Final Fantasy III Redux (Final Fantasy III modification) (1.3.0) (En).nes
./DuckTales 2 - New Journey/Disney's DuckTales 2 - New Journey (Disney's DuckTales 2 modification) (1.1).nes
./Boss/Boss (Gun.Smoke modification) (1.0).nes
./Lode Runner Gray/Lode Runner Gray (Lode Runner modification) (1.0).nes
./Blaster Master (Wastelands)/Blaster Master - Wastelands (Blaster Master modification) (2.6).nes
./Aladdin (Hummer Team Deluxe)/Aladdin - Hummer Team Deluxe (Aladdin modification) (1.0).nes
./Alien 3 Plus/Alien 3 Plus (Alien 3 modification) (1.0).nes
./Mario Adventure/Mario Adventure (Super Mario Bros. 3 modification) (1.0).nes
./Deadpool/Deadpool (Ninja Gaiden modification) (Final).nes
./Zelda II - The Adventure of Link (Master Quest)/Zelda II - The Adventure of Link - Master Quest (Zelda II - The Adventure of Link modification) (1.0).nes
./Faxanadu (Restoration)/Faxanadu - Restoration (Faxanadu modification) (1.01).nes
./Zelda II - The Adventure of Link (Easy Mode)/Zelda II - The Adventure of Link - Easy Mode (Zelda II - The Adventure of Link modification) (1.0).nes
./Dragoon X Omega - Gold Edition/Dragoon X Omega - Gold Edition (Dragon Warrior modification) (2.0f).nes
./Rockman - 2019 New Year's Hack/Rockman - 2019 New Year's Hack (Mega Man 5 modification) (1.0).nes
./Ultimate Mortal Kombat 3/Ultimate Mortal Kombat 3 (Mortal Kombat 4 modification) (14.69d).nes

[maniac79]

@frederic-mahe Thx for the list, that helps a lot. I have already downloaded all the missing NES hacks as per your list and will create a PR soon, probably tomorrow. :)

But, are there any other categories of interest, like, does Cylum have any significant licensed games missing in No-Intro or maybe later versions compared to No-Intro? I doubt it though.

However, maybe more relevant: What about the other consoles like Genesis, TG16, ...?

Regarding SMDB being out of synch with No-Intro, are you referring to the topic we have discussed yesterday in the now-closed issue? If yes, I don't know what else to say. It seems that the CRC-32 in the DAT-file do not match the "true" CRC-32. Let's take the famous Mega Man 3 (USA) as an example again. The SMDB says: 452d8089 All files in recent No-Intro from sets are: 452d8089 And my ROM management tool confirmed 452d8089 is correct - with a fresh DAT file created yesterday. Although, when you open the DAT file with a text editor and if you check the database online, it says 603AAA57. And it's not the case that the checksum has been changed recently: Dat-o-Matic All verified hashes in dat-o-matic are from 2005-2007. And as I stated last night, there is the same issue (if it's one...) with Mega Man 2 and I'm sure for all other NES ROMs as well for some strange reason. I strongly believe that the hash in SMDB is correct but I don't have any clue how to prove it.

Sorry for the wall of text. If you were referring to something else, please open a new issue and explain.

[frederic-mahe]

I have already downloaded all the missing NES hacks as per your list and will create a PR soon, probably tomorrow. :)

Great, but as you wrote maintaining lists of hacks is a lot of work. Feel free to explore Cylum's NES set or sets for other consoles, but I think I am going to close that issue (not specific enough). Of course, new issues regarding specific aspects of Cylum's sets can be opened.

Regarding SMDB being out of synch with No-Intro, are you referring to the topic we have discussed yesterday in the now-closed issue? If yes, I don't know what else to say. It seems that the CRC-32 in the DAT-file do not match the "true" CRC-32.

NES is a special case, as I think No-Intro is shifting to headerless ROMs, which of course have different checksums than the ROMs we have been using for years.

What I meant with being out of synch with No-Intro or Redump is that entries are regularly added, renamed, or removed. SmokeMonster made sure to update the packs to match No-Intro's latest versions, we should try to do the same.

Let's take the famous Mega Man 3 (USA) as an example again. The SMDB says: 452d8089 All files in recent No-Intro from sets are: 452d8089 And my ROM management tool confirmed 452d8089 is correct - with a fresh DAT file created yesterday. Although, when you open the DAT file with a text editor and if you check the database online, it says 603AAA57. And it's not the case that the checksum has been changed recently: Dat-o-Matic All verified hashes in dat-o-matic are from 2005-2007. And as I stated last night, there is the same issue (if it's one...) with Mega Man 2 and I'm sure for all other NES ROMs as well for some strange reason. I strongly believe that the hash in SMDB is correct but I don't have any clue how to prove it.

I'll have a look at this case, but it could be a simple matter or removing the ROM header to match the 603AAA57 CRC.

[frederic-mahe]

The scope of that issue is a bit too wide, so I am going to close it.