search

farmerbb / RED-Project

ROM Extraction Documentation Project
183 stars 8 forks source link

Additional Info #5

Open ValadAmoleo opened 4 years ago

ValadAmoleo commented 4 years ago

Just to contribute a little to this project, here's a list of links which contain all the information I have regarding extracting ROMs from retail games. This doesn't include any of the extracting from physical media guides or Virtual Consoles that I've found because that's widely covered.

One of the best online covering many games: https://gitlab.com/vaiski/romextract/tree/master

Street Fighter 30th Anniversary Collection https://github.com/ValadAmoleo/sf30ac-extractor That's my fork of it but even my work was just implementing something that @ghoost82 had found.

Mega Man X Legacy Collection 1 https://github.com/s3phir0th115/MMXLC1-Rom-Extractor

Colecovision Flashback https://github.com/anpage/Colecovision-Flashback-40-Game-Pack-ROM-Extractor

DotEmu releases https://gist.github.com/cxx/81b9f45eb5b3cb87b4f3783ccdf8894f

Ultimate NES Remix https://github.com/aspargas2/3DS-Tutorials/wiki/Ultimate-NES-Remix-ROMs-Extraction

Johnny Turbo's Arcade (Switch) Using NXDumpTool on the Switch I was able to located the ROM in the RomFS section at /Data/StreamingAssets/[romname].zip. This then works in MAME and FinalBurn Neo.

SNK 40th Anniversary Collection (Switch) You can follow the same steps to extract the games from the mbundle files on the Switch version too. Though, for me, it didn't extract all the games.

You've already done these but for completion sake: Castlevania / Contra Anniversary collection https://pastebin.com/suFHCH6K

Bonus extracting from Capcom Home Arcade https://neo-source.com/index.php?topic=3558.0

ValadAmoleo commented 4 years ago

Street Hoop (Steam)

Street Hoop on Steam contains the Neo Geo ROM and BIOS at \Street Hoop\roms. It's made by Digicon, they don't seem to have any other games available.

ValadAmoleo commented 4 years ago

Iridion 3D & Iridion II (Steam)

Iridion 1 & 2 on Steam contains the GBA ROM at \res\game. Piko Interactive who have other games which contain their original ROMs.

ValadAmoleo commented 3 years ago

SNK Gals' Fighters (Switch)

Using NXDumpTool on the Switch I was able to locate the ROM in the RomFS section at /game/SNK/NGPC/. Includes EU/US, Japanese versions and the BIOS. This then works in Mednafen. Currently SNK have only released one of the NGPC games onto the public eShop but they also have SAMURAI SHODOWN! 2 and King of Fighters R-2. A very good way to get these, in the UK at least they start at three times the cost to buy physical versions.

This is the website for the line: https://www.snk-corp.co.jp/us/games/ngpcs/

farmerbb commented 3 years ago

Hey, thanks a lot for all of this info. I know this reply is late but I really appreciate you taking the time to post it all here.

Regarding the DotEmu conversion script, looks like there's another script from the same author for converting the Atari Vault arcade games to Mame format: https://gist.github.com/cxx/6d1d44ce4a6107ed80e0a6c8c5b887c4. Looking forward to testing both of those out.

ValadAmoleo commented 3 years ago

That's okay. As I come across more I'll keep updating this. There's not many of us around so we've got to try and get this info out there some how.

ValadAmoleo commented 3 years ago

Namco Collection (Switch)

The instructions for the Steam version of the Namco Collections also works on the Switch version once you've extracted alldata.psb.m.

ValadAmoleo commented 3 years ago

Arcade (Hamster Arcade Archives)

Extracting the ROMs out of the Arcade Archives series by Hamster seems to be very difficult. I've just attempted to look at Kid's Horehore Daisakusen and I can't even begin to extract it. It looks like the actual ROM files are stored in the executable.

ValadAmoleo commented 3 years ago

Atari 12-in-1, Centipede, Asteroids, & Rampage (Arcade1Up)

This should apply to all Arcade1Up Gen 1 boards but the ones listed are the only ones which use MAME/FBA and so have easily usable ROMs. The rest use Digital Eclipse's MOO which is awkward to extract (see Street Fighter Anniversary Collection).

This is taken from https://www.reddit.com/r/Arcade1Up/comments/a02870/hack_original_board_not_just_replace_w_pietc/ but put into steps to achieve ROM extraction.

Solder the UART pins and a female USB socket. image The USB pins are GND, D-, D+, 5V while the UART are (from the outside edge of the board) GND, TX, RX, 3.3V. The original post says to not connect the 3.3v up but I only got 0kb files when I did a copy to the USB without it. So try without and use if that happens.

To connect the UART pins to my computer I used this: https://www.ebay.co.uk/itm/6Pin-USB-2-0-to-TTL-UART-Serial-Converter-CP2102-STC-Replace-Ft232/181951886097

Next plug in the control board (or determine which pins on the long connector correspond to which buttons so you can short them out).

Connect the UART to your PC and insert a USB flash drive into the female USB socket you added earlier.

Using PUTTY connect to the board over the serial connection (-115200,N,8,1).

Power the control board from it's barrel plug and turn it on using the power button (or by shorting out the correct pins).

You should now see the boot log in the PUTTY window. Eventually it'll stop and ask for a username (default or newborg) and password (mimebox or newborg). I think for the boards we're looking at it should be the former for both.

Via the PUTTY session use vi to edit /root/mameload.sh and add a new line at the top: echo -e "pass\npass" | passwd root.

Exit vi (ZZ) and reboot the device. When it's finished rebooting you will need to launch a game, so press A on the control panel (or by shorting the correct pins). This will now set the root password as root. Reboot the device again.

This time login using the username root and password root. Now mount your USB drive (mount /dev/uba1 /mnt/udisk).

Finally copy the /root/roms folder to your mounted drive.

These are the roms available: Atari 12-in-1: astdelux.zip, asteroid.zip, ccastles.zip, centiped.zip, gravitar.zip, liberatr.zip, llander.zip, mhavoc.zip, milliped.zip, missile.zip, quantum.zip, quantum1.zip, quantump.zip & tempest.zip Centipede: ccastles.zip, centiped.zip, milliped.zip & missile.zip. Asteroids: asteroid.zip, llander.zip, mhavoc.zip & tempest.zip. Rampage: defender.zip, gaunt2pr3.zip, gauntlet.zip, gauntlet2p.zip, gauntlet2pg.zip, gauntlet2pg1.zip, gauntlet2pj.zip, gauntlet2pj2.zip, joust.zip & rampage.zip

ValadAmoleo commented 3 years ago

Neo Geo (Google Play)

UPDATE: Disregard this post. I used a rooted phone and root file explorer to extract the unpacked data files and they worked perfectly, in fact, they created perfect dumps.

Old post: The DotEmu2Mame link in the original post does NOT seem to work for KoF '97 and KoF '98 from Google Play. These two are no longer available to purchase on Steam in the original form so I thought I'd try the Google Play route. It wasn't as simple as just extracting the APK from the device, I had to start the games so they could unpack and then extract their Data files (I used Clockworkmod's Helium to do it on an unrooted phone).

Running the DotEmu2Mame script resulted in zip files that looked correct but they are unplayable in every emulator I tried.

Final Burn Neo displays this validation info: kof97 The following ROMs are invalid: • essential program ROM 232-p1.p1 has a CRC of 44D925B8 (correct is 7DB81AD9). • essential program ROM 232-p2.sp2 has a CRC of 241588EE (correct is 158B23F6). • graphics ROM 232-s1.s1 is 128k which is too large (correct is 128kB). • graphics ROM 232-c1.c1 has a CRC of 0BB06D7C (correct is 5F8BF0A1). • graphics ROM 232-c2.c2 has a CRC of 6522D711 (correct is E4D45C81). • graphics ROM 232-c3.c3 has a CRC of D15206CE (correct is 581D6618). • graphics ROM 232-c4.c4 has a CRC of CEC5894B (correct is 49BB1E68). • graphics ROM 232-c5.c5 is 4099k which is too large (correct is 4096kB). • graphics ROM 232-c6.c6 is 4099k which is too large (correct is 4096kB). • essential program ROM 232-m1.m1 is 128k which is too large (correct is 128kB). • sound ROM 232-v1.v1 has a CRC of E817DC1D (correct is 22A2B5B5). • sound ROM 232-v2.v2 has a CRC of 0E716112 (correct is 2304E744). • sound ROM 232-v3.v3 has a CRC of 492AC9C7 (correct is 759EB954). • essential BIOS program ROM vs-bios.rom is 128k which is too large (correct is 128kB). • essential BIOS ROM 000-lo.lo is 128k which is too large (correct is 128kB).

kof98h The following ROMs are invalid: • essential program ROM 242-pn1.p1 has a CRC of 6D0A5387 (correct is 61AC868A). • essential program ROM 242-p2.sp2 has a CRC of 1634E199 (correct is 980ABA4C). • graphics ROM 242-s1.s1 is 128k which is too large (correct is 128kB). • graphics ROM 242-c1.c1 has a CRC of 8BD4EEDA (correct is E564ECD6). • graphics ROM 242-c2.c2 has a CRC of FA1F8227 (correct is BD959B60). • graphics ROM 242-c3.c3 has a CRC of FABB62DE (correct is 22127B4F). • graphics ROM 242-c4.c4 has a CRC of 934E1E62 (correct is 0B4FA044). • graphics ROM 242-c5.c5 has a CRC of 178D08A7 (correct is 9D10BED3). • graphics ROM 242-c6.c6 has a CRC of 0C4F3238 (correct is DA07B6A2). • graphics ROM 242-c7.c7 has a CRC of DAC92F2C (correct is F6D7A38A). • graphics ROM 242-c8.c8 has a CRC of D19AE208 (correct is C823E045). • essential program ROM 242-mg1.m1 is 256k which is too large (correct is 256kB). • sound ROM 242-v1.v1 has a CRC of 821A9FDF (correct is B9EA8051). • sound ROM 242-v2.v2 has a CRC of 342F93D8 (correct is CC11106E). • sound ROM 242-v3.v3 has a CRC of BAD60252 (correct is 044EA4E1). • sound ROM 242-v4.v4 has a CRC of 39A95639 (correct is 7985EA30).

When extracting roms like this, it's not unusual to have this sort of messy validation, as the files have usually been tampered with when compared to the originals, but in this case the files just seem to be incorrect.

I do wonder if the way I extracted them from my Android device caused issues as that DotEmu2Mame script has worked perfect for everything else. Including the two R-Type games on Google Play that I tried (those just require you to extract the APK from your device). If anybody has any suggestions about extracting the data partitions, please let me know.

ValadAmoleo commented 3 years ago

SEGA AGES (Switch) To unpack these files from their alldata.bin/alldata.psb.m format follow the guide for Konami games in the Wiki. Some are bare rom files, others need additional step.

Update: Updated to include information on extracting those using the CCF file type.

Arcade Games (Fantasy Zone, Gain Ground, G-LOC Air Battle, Lightening Force, Outrun, Shinobi) So although the arcade games in this collection are using an emulator, I can't extract their data... or even find it. Maybe it's in the exe_fs?

Alex Kidd In Miracle World Contains the Japanese, Europe/US and the built in Master System II version within CCF files that are located in /system/roms/. Use this tool to extract. Change the file extension of CPU.bin to sms to use.

Columns II Mega Drive ROM is located in /system/roms/. It's the GEN file. This also contains the Sega System C2 version in a CCF file. Use this tool to extract. It contains cpu.bin (main_cpu). I'm currently updating my tool to support conversion.

Herzog Zwei Mega Drive ROM is located in /system/roms/, It's named as SGD files, but rename it to gen or bin and it will work fine in emulators etc.

Ichidant-R Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I've been able to convert this into a usable MAME ROM. I'm currently updating my tool to support conversion.

Phantasy Star Located in /system/roms/ is the European/American SMS ROM but with FM Sound! So this was a nice find.

Puyo Puyo (Broken) Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. It contains cpu.bin (main_cpu) and 31 wav files (upd). I'm currently updating my tool to support conversion. Unfortunately this one seems to suffer graphics corruption at the moment.

Puyo Puyo 2 Contains the Sega System C2 version within the CCF file located in /system/roms/, At least I think it is as it's listed as C2. But the cpu.bin file says SEGA MEGA DRIVE, much like the header in a Mega Drive ROM. Use this tool to extract. I'm currently updating my tool to support conversion.

Sonic The Hedgehog Mega Drive ROM is located in /system/roms/, Contains Sonic 1 and the USA version. They're named as SGD files, but rename them to gen or bin and they work fine in emulators etc. This also contains the Sega Mega Play version in a CCF file. Use this tool to extract. It contains the mtbios, main_cpu and user1 files. I'm currently updating my tool to support conversion.

Sonic The Hedgehog 2 Mega Drive ROM is located in /system/roms/. Contains Sonic 2 and Sonic 3 & Knuckles. Again they're SGD files but just rename them to gen or bin.

Thunder Force AC Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I'm currently updating my tool to support conversion.

Thunder Force IV Mega Drive ROM is located in /system/roms/, Contains Thunder Force IV (Japanese) and Lightening Force (USA). SGD files, just rename them to gen or bin.

Virtua Racing Another arcade game. This time it has a zip file located in /system/roms. Unfortunately this isn't simply a MAME rom which has been included. Whether it can be split up and converted is a different story though. One to look into. This is the MAME reference: https://github.com/mamedev/mame/blob/master/src/mame/drivers/model1.cpp

einstein95 commented 3 years ago

If you could upload some CCF files, I can look at unpacking them.

ValadAmoleo commented 3 years ago

I didn't see the above comment. Either way sharing copyrighted files is against what we're trying to do here.

Thankfully I have actually been able to find out how to extract these CCF files. A discussion here resulted in the the author of CCFEX updating their application to support these type of files.

Unfortunately this has only resulted in immediately usable ROMs for Alex Kidd In Miracle World for the SMS. Though it has lead to interesting information about the others. Will update the original post about this Switch Sega Ages.

Update: While messing around updating the original Switch Sega Ages post I actually figured out how to get most of the games working! Woo!

ValadAmoleo commented 3 years ago

Marvel vs. Capcom 2: New Age of Heroes (Xbox 360)

Extracting this from the Xbox 360 file format shows that there is a folder called gd_rom. It contains most of the files from the original GD-ROM but unfortunately is missing a few key ones. I was able to frankenstein a GDI file together by editing the IP.BIN from another game (I had to change the initial executable from 0.bin to 1ST_READ.BIN) and then using GDIbuilder on the gd_rom folder.

This actually achieved more than I expected. The resulting GDI boots in Demul! But that's about all it does. It'll play the intro video fine. The menus will display but with what looks like debug text overlaid. You can navigate the main menu but pressing A will always start Arcade Mode, no matter what option you're on. When in the character select, you can choose any characters. You see all the animations and sounds on that screen. You can even press start! The level will load (including animations) but as soon as the characters are supposed to appear it hard locks.

I was surprised by how close I was to getting it working but it looks like there was enough change for the Xbox 360 release that it's not a straight forward repackage.

ValadAmoleo commented 3 years ago

Capcom Arcade Stadium (Switch)

You'll need to extract the re_chunk_000.pak (main game) or re_dlc_000.pak (DLC) files from the RomFS on your Switch using NXDumpTool. Once you've got these pak files follow the instructions on this website to unpack them. The arcade games are the only zip files which will be unpacked so should be pretty easy to spot.

UPDATE: It looks like the main DLC files might require some form of conversion. I've only got GnG at the moment so I've not been able to look into it.

ValadAmoleo commented 3 years ago

NEOGEO (Hamster Arcade Archives NEOGEO)

I've updated my tool to support converting from the following Arcade Archive NEOGEO games:

You'll need to have extracted the RomFS from the Switch yourself.

ValadAmoleo commented 3 years ago

Sega Mega Drive Ultimate Collection/Sonic's Ultimate Genesis Collection (Xbox 360)

Mega Drive/Genesis and Master System These games are contained within the /flog_U.fpg file. They're almost all available in easier ways (Sega Mega Drive Collection on Steam) but it does contain Golden Axe Warrior which is quite expensive to pick up in the UK, To extract do the following:

  1. On the Xbox 360 install the CD to an external USB drive or move your already installed/downloaded file to an external USB drive.
  2. On the PC use God2ISO to convert the Xbox 360 format to an ISO.
  3. Use gxISO to extract this ISO.
  4. Download these two scripts func_getTYPE and XBLA flog_x360.fpg extractor.
  5. Use QuickBMS with the XBLA flog_x360.fpg extractor script to extract flog_U.fpg.
  6. These files will have random names but it contains the Mega Drive and Master System Games. Rename the Mega Drive games to .bin and the Master System games to .sms.

Arcade I currently can't find the arcade games in the files but I will continue to look.

60fpshacksrock commented 2 years ago

Can I ask how to download the func_getTYPE.bms script?

I have had this quickbms tool for a while and have used it before.

The thing about that script is that it is split into three parts. May I ask which one to use or do they have to be combined? I have in the past extracted these files another way though. With VGMToolbox's zlib extractor but I would prefer to use quickbms on it instead.

I am speaking of the Sonic's UGC file by the way. The PS3 version seems to use the same format.

ValadAmoleo commented 2 years ago

Can I ask how to download the func_getTYPE.bms script?

I have had this quickbms tool for a while and have used it before.

The thing about that script is that it is split into three parts. May I ask which one to use or do they have to be combined? I have in the past extracted these files another way though. With VGMToolbox's zlib extractor but I would prefer to use quickbms on it instead.

I am speaking of the Sonic's UGC file by the way. The PS3 version seems to use the same format.

I think you need to login to that forum to see the attached file.

60fpshacksrock commented 2 years ago

Okay. Thank you.

I must have missed that.

ArhumMK commented 2 years ago

Hello, sorry If this isn't the right way and place to ask but I would be grateful If you could write down or provide links to any guide/post that has instructions on extracting the roms from the Google Play Neo Geo releases. I'm confused on what to do, does that script work or is there an easier method? And If it does, how do I do it as i'm not familiar with how to get that script with node.js running. Thanks.

ValadAmoleo commented 2 years ago

Hello, sorry If this isn't the right way and place to ask but I would be grateful If you could write down or provide links to any guide/post that has instructions on extracting the roms from the Google Play Neo Geo releases. I'm confused on what to do, does that script work or is there an easier method? And If it does, how do I do it as i'm not familiar with how to get that script with node.js running. Thanks.

farmerbb has actually added the Google Play extraction method to the wiki now. https://github.com/farmerbb/RED-Project/wiki/R-Type

It's R-Type but it uses the same script as the Neo Geo games did, so you can follow that. Unfortunately the Neo Geo games that this script is made for are no longer available on Google Play and this can be a very tricky method.

ArhumMK commented 2 years ago

Huh yeah the process is far beyond my knowledge, I was hoping if there was some automated batch file process or a standalone program or hell, hex editing certain strings in the files to make it work. Thanks for replying!

MrVtR commented 1 year ago

SEGA AGES (Switch) To unpack these files from their alldata.bin/alldata.psb.m format follow the guide for Konami games in the Wiki. Some are bare rom files, others need additional step.

Update: Updated to include information on extracting those using the CCF file type.

Arcade Games (Fantasy Zone, Gain Ground, G-LOC Air Battle, Lightening Force, Outrun, Shinobi) So although the arcade games in this collection are using an emulator, I can't extract their data... or even find it. Maybe it's in the exe_fs?

Alex Kidd In Miracle World Contains the Japanese, Europe/US and the built in Master System II version within CCF files that are located in /system/roms/. Use this tool to extract. Change the file extension of CPU.bin to sms to use.

Columns II Mega Drive ROM is located in /system/roms/. It's the GEN file. This also contains the Sega System C2 version in a CCF file. Use this tool to extract. It contains cpu.bin (main_cpu). I'm currently updating my tool to support conversion.

Herzog Zwei Mega Drive ROM is located in /system/roms/, It's named as SGD files, but rename it to gen or bin and it will work fine in emulators etc.

Ichidant-R Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I've been able to convert this into a usable MAME ROM. I'm currently updating my tool to support conversion.

Phantasy Star Located in /system/roms/ is the European/American SMS ROM but with FM Sound! So this was a nice find.

Puyo Puyo (Broken) Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. It contains cpu.bin (main_cpu) and 31 wav files (upd). I'm currently updating my tool to support conversion. Unfortunately this one seems to suffer graphics corruption at the moment.

Puyo Puyo 2 Contains the Sega System C2 version within the CCF file located in /system/roms/, At least I think it is as it's listed as C2. But the cpu.bin file says SEGA MEGA DRIVE, much like the header in a Mega Drive ROM. Use this tool to extract. I'm currently updating my tool to support conversion.

Sonic The Hedgehog Mega Drive ROM is located in /system/roms/, Contains Sonic 1 and the USA version. They're named as SGD files, but rename them to gen or bin and they work fine in emulators etc. This also contains the Sega Mega Play version in a CCF file. Use this tool to extract. It contains the mtbios, main_cpu and user1 files. I'm currently updating my tool to support conversion.

Sonic The Hedgehog 2 Mega Drive ROM is located in /system/roms/. Contains Sonic 2 and Sonic 3 & Knuckles. Again they're SGD files but just rename them to gen or bin.

Thunder Force AC Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I'm currently updating my tool to support conversion.

Thunder Force IV Mega Drive ROM is located in /system/roms/, Contains Thunder Force IV (Japanese) and Lightening Force (USA). SGD files, just rename them to gen or bin.

Virtua Racing Another arcade game. This time it has a zip file located in /system/roms. Unfortunately this isn't simply a MAME rom which has been included. Whether it can be split up and converted is a different story though. One to look into. This is the MAME reference: https://github.com/mamedev/mame/blob/master/src/mame/drivers/model1.cpp

Hello, where can I find this Konami guide? I didn't find in the repo Wiki here I was looking to extract the Phantasy Star alldata.bin/psb.m

ValadAmoleo commented 1 year ago

SEGA AGES (Switch) To unpack these files from their alldata.bin/alldata.psb.m format follow the guide for Konami games in the Wiki. Some are bare rom files, others need additional step. Update: Updated to include information on extracting those using the CCF file type. Arcade Games (Fantasy Zone, Gain Ground, G-LOC Air Battle, Lightening Force, Outrun, Shinobi) So although the arcade games in this collection are using an emulator, I can't extract their data... or even find it. Maybe it's in the exe_fs? Alex Kidd In Miracle World Contains the Japanese, Europe/US and the built in Master System II version within CCF files that are located in /system/roms/. Use this tool to extract. Change the file extension of CPU.bin to sms to use. Columns II Mega Drive ROM is located in /system/roms/. It's the GEN file. This also contains the Sega System C2 version in a CCF file. Use this tool to extract. It contains cpu.bin (main_cpu). I'm currently updating my tool to support conversion. Herzog Zwei Mega Drive ROM is located in /system/roms/, It's named as SGD files, but rename it to gen or bin and it will work fine in emulators etc. Ichidant-R Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I've been able to convert this into a usable MAME ROM. I'm currently updating my tool to support conversion. Phantasy Star Located in /system/roms/ is the European/American SMS ROM but with FM Sound! So this was a nice find. Puyo Puyo (Broken) Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. It contains cpu.bin (main_cpu) and 31 wav files (upd). I'm currently updating my tool to support conversion. Unfortunately this one seems to suffer graphics corruption at the moment. Puyo Puyo 2 Contains the Sega System C2 version within the CCF file located in /system/roms/, At least I think it is as it's listed as C2. But the cpu.bin file says SEGA MEGA DRIVE, much like the header in a Mega Drive ROM. Use this tool to extract. I'm currently updating my tool to support conversion. Sonic The Hedgehog Mega Drive ROM is located in /system/roms/, Contains Sonic 1 and the USA version. They're named as SGD files, but rename them to gen or bin and they work fine in emulators etc. This also contains the Sega Mega Play version in a CCF file. Use this tool to extract. It contains the mtbios, main_cpu and user1 files. I'm currently updating my tool to support conversion. Sonic The Hedgehog 2 Mega Drive ROM is located in /system/roms/. Contains Sonic 2 and Sonic 3 & Knuckles. Again they're SGD files but just rename them to gen or bin. Thunder Force AC Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I'm currently updating my tool to support conversion. Thunder Force IV Mega Drive ROM is located in /system/roms/, Contains Thunder Force IV (Japanese) and Lightening Force (USA). SGD files, just rename them to gen or bin. Virtua Racing Another arcade game. This time it has a zip file located in /system/roms. Unfortunately this isn't simply a MAME rom which has been included. Whether it can be split up and converted is a different story though. One to look into. This is the MAME reference: https://github.com/mamedev/mame/blob/master/src/mame/drivers/model1.cpp

Hello, where can I find this Konami guide? I didn't find in the repo Wiki here I was looking to extract the Phantasy Star alldata.bin/psb.m

Ah I think it got split out after this was posted.

This one should work: https://github.com/farmerbb/RED-Project/wiki/Contra-Anniversary-Collection

MrVtR commented 1 year ago

SEGA AGES (Switch) To unpack these files from their alldata.bin/alldata.psb.m format follow the guide for Konami games in the Wiki. Some are bare rom files, others need additional step. Update: Updated to include information on extracting those using the CCF file type. Arcade Games (Fantasy Zone, Gain Ground, G-LOC Air Battle, Lightening Force, Outrun, Shinobi) So although the arcade games in this collection are using an emulator, I can't extract their data... or even find it. Maybe it's in the exe_fs? Alex Kidd In Miracle World Contains the Japanese, Europe/US and the built in Master System II version within CCF files that are located in /system/roms/. Use this tool to extract. Change the file extension of CPU.bin to sms to use. Columns II Mega Drive ROM is located in /system/roms/. It's the GEN file. This also contains the Sega System C2 version in a CCF file. Use this tool to extract. It contains cpu.bin (main_cpu). I'm currently updating my tool to support conversion. Herzog Zwei Mega Drive ROM is located in /system/roms/, It's named as SGD files, but rename it to gen or bin and it will work fine in emulators etc. Ichidant-R Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I've been able to convert this into a usable MAME ROM. I'm currently updating my tool to support conversion. Phantasy Star Located in /system/roms/ is the European/American SMS ROM but with FM Sound! So this was a nice find. Puyo Puyo (Broken) Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. It contains cpu.bin (main_cpu) and 31 wav files (upd). I'm currently updating my tool to support conversion. Unfortunately this one seems to suffer graphics corruption at the moment. Puyo Puyo 2 Contains the Sega System C2 version within the CCF file located in /system/roms/, At least I think it is as it's listed as C2. But the cpu.bin file says SEGA MEGA DRIVE, much like the header in a Mega Drive ROM. Use this tool to extract. I'm currently updating my tool to support conversion. Sonic The Hedgehog Mega Drive ROM is located in /system/roms/, Contains Sonic 1 and the USA version. They're named as SGD files, but rename them to gen or bin and they work fine in emulators etc. This also contains the Sega Mega Play version in a CCF file. Use this tool to extract. It contains the mtbios, main_cpu and user1 files. I'm currently updating my tool to support conversion. Sonic The Hedgehog 2 Mega Drive ROM is located in /system/roms/. Contains Sonic 2 and Sonic 3 & Knuckles. Again they're SGD files but just rename them to gen or bin. Thunder Force AC Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I'm currently updating my tool to support conversion. Thunder Force IV Mega Drive ROM is located in /system/roms/, Contains Thunder Force IV (Japanese) and Lightening Force (USA). SGD files, just rename them to gen or bin. Virtua Racing Another arcade game. This time it has a zip file located in /system/roms. Unfortunately this isn't simply a MAME rom which has been included. Whether it can be split up and converted is a different story though. One to look into. This is the MAME reference: https://github.com/mamedev/mame/blob/master/src/mame/drivers/model1.cpp

Hello, where can I find this Konami guide? I didn't find in the repo Wiki here I was looking to extract the Phantasy Star alldata.bin/psb.m

Ah I think it got split out after this was posted.

This one should work: https://github.com/farmerbb/RED-Project/wiki/Contra-Anniversary-Collection

Thanks! It worked with no problems, back to the game now 😁

ValadAmoleo commented 1 year ago

Darius Cozmic Collection Console - Switch The instructions for extracting Contra also work for this collection. https://github.com/farmerbb/RED-Project/wiki/Contra-Anniversary-Collection

TideGear commented 1 year ago

Any ideas on getting the ROM out of this one? https://www.nintendo.com/store/products/mega-man-battle-and-fighters-switch/

ValadAmoleo commented 1 year ago

Any ideas on getting the ROM out of this one? https://www.nintendo.com/store/products/mega-man-battle-and-fighters-switch/

I don't have this one but as it's part of the Neo Geo Pocket Colour range I'd suspect it'd be the same as https://github.com/farmerbb/RED-Project/issues/5#issuecomment-660983789 Remember you need a Switch that you can run Homebrew on to use the tools.

PW5190 commented 1 year ago

SEGA AGES (Switch) To unpack these files from their alldata.bin/alldata.psb.m format follow the guide for Konami games in the Wiki. Some are bare rom files, others need additional step.

Update: Updated to include information on extracting those using the CCF file type.

Arcade Games (Fantasy Zone, Gain Ground, G-LOC Air Battle, Lightening Force, Outrun, Shinobi) So although the arcade games in this collection are using an emulator, I can't extract their data... or even find it. Maybe it's in the exe_fs?

Alex Kidd In Miracle World Contains the Japanese, Europe/US and the built in Master System II version within CCF files that are located in /system/roms/. Use this tool to extract. Change the file extension of CPU.bin to sms to use.

Columns II Mega Drive ROM is located in /system/roms/. It's the GEN file. This also contains the Sega System C2 version in a CCF file. Use this tool to extract. It contains cpu.bin (main_cpu). I'm currently updating my tool to support conversion.

Herzog Zwei Mega Drive ROM is located in /system/roms/, It's named as SGD files, but rename it to gen or bin and it will work fine in emulators etc.

Ichidant-R Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I've been able to convert this into a usable MAME ROM. I'm currently updating my tool to support conversion.

Phantasy Star Located in /system/roms/ is the European/American SMS ROM but with FM Sound! So this was a nice find.

Puyo Puyo (Broken) Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. It contains cpu.bin (main_cpu) and 31 wav files (upd). I'm currently updating my tool to support conversion. Unfortunately this one seems to suffer graphics corruption at the moment.

Puyo Puyo 2 Contains the Sega System C2 version within the CCF file located in /system/roms/, At least I think it is as it's listed as C2. But the cpu.bin file says SEGA MEGA DRIVE, much like the header in a Mega Drive ROM. Use this tool to extract. I'm currently updating my tool to support conversion.

Sonic The Hedgehog Mega Drive ROM is located in /system/roms/, Contains Sonic 1 and the USA version. They're named as SGD files, but rename them to gen or bin and they work fine in emulators etc. This also contains the Sega Mega Play version in a CCF file. Use this tool to extract. It contains the mtbios, main_cpu and user1 files. I'm currently updating my tool to support conversion.

Sonic The Hedgehog 2 Mega Drive ROM is located in /system/roms/. Contains Sonic 2 and Sonic 3 & Knuckles. Again they're SGD files but just rename them to gen or bin.

Thunder Force AC Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I'm currently updating my tool to support conversion.

Thunder Force IV Mega Drive ROM is located in /system/roms/, Contains Thunder Force IV (Japanese) and Lightening Force (USA). SGD files, just rename them to gen or bin.

Virtua Racing Another arcade game. This time it has a zip file located in /system/roms. Unfortunately this isn't simply a MAME rom which has been included. Whether it can be split up and converted is a different story though. One to look into. This is the MAME reference: https://github.com/mamedev/mame/blob/master/src/mame/drivers/model1.cpp

Doesn't SEGA AGES Ichidant-R also contain a Mega Drive ROM for the game?

PW5190 commented 1 year ago

Also, for Phantasy Star, the English ROM with FM sound was patched incorrectly. Someone over at the Rockin' the Classics Discord told me this.

ValadAmoleo commented 1 year ago

SEGA AGES (Switch) To unpack these files from their alldata.bin/alldata.psb.m format follow the guide for Konami games in the Wiki. Some are bare rom files, others need additional step. Update: Updated to include information on extracting those using the CCF file type. Arcade Games (Fantasy Zone, Gain Ground, G-LOC Air Battle, Lightening Force, Outrun, Shinobi) So although the arcade games in this collection are using an emulator, I can't extract their data... or even find it. Maybe it's in the exe_fs? Alex Kidd In Miracle World Contains the Japanese, Europe/US and the built in Master System II version within CCF files that are located in /system/roms/. Use this tool to extract. Change the file extension of CPU.bin to sms to use. Columns II Mega Drive ROM is located in /system/roms/. It's the GEN file. This also contains the Sega System C2 version in a CCF file. Use this tool to extract. It contains cpu.bin (main_cpu). I'm currently updating my tool to support conversion. Herzog Zwei Mega Drive ROM is located in /system/roms/, It's named as SGD files, but rename it to gen or bin and it will work fine in emulators etc. Ichidant-R Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I've been able to convert this into a usable MAME ROM. I'm currently updating my tool to support conversion. Phantasy Star Located in /system/roms/ is the European/American SMS ROM but with FM Sound! So this was a nice find. Puyo Puyo (Broken) Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. It contains cpu.bin (main_cpu) and 31 wav files (upd). I'm currently updating my tool to support conversion. Unfortunately this one seems to suffer graphics corruption at the moment. Puyo Puyo 2 Contains the Sega System C2 version within the CCF file located in /system/roms/, At least I think it is as it's listed as C2. But the cpu.bin file says SEGA MEGA DRIVE, much like the header in a Mega Drive ROM. Use this tool to extract. I'm currently updating my tool to support conversion. Sonic The Hedgehog Mega Drive ROM is located in /system/roms/, Contains Sonic 1 and the USA version. They're named as SGD files, but rename them to gen or bin and they work fine in emulators etc. This also contains the Sega Mega Play version in a CCF file. Use this tool to extract. It contains the mtbios, main_cpu and user1 files. I'm currently updating my tool to support conversion. Sonic The Hedgehog 2 Mega Drive ROM is located in /system/roms/. Contains Sonic 2 and Sonic 3 & Knuckles. Again they're SGD files but just rename them to gen or bin. Thunder Force AC Contains the Sega System C2 (US and JP) version within the CCF files located in /system/roms/. Use this tool to extract. I'm currently updating my tool to support conversion. Thunder Force IV Mega Drive ROM is located in /system/roms/, Contains Thunder Force IV (Japanese) and Lightening Force (USA). SGD files, just rename them to gen or bin. Virtua Racing Another arcade game. This time it has a zip file located in /system/roms. Unfortunately this isn't simply a MAME rom which has been included. Whether it can be split up and converted is a different story though. One to look into. This is the MAME reference: https://github.com/mamedev/mame/blob/master/src/mame/drivers/model1.cpp

Doesn't SEGA AGES Ichidant-R also contain a Mega Drive ROM for the game?

I’m not sure about this, I don’t think it did when I looked ages ago. But I’ll double check and edit this comment when I can.

Also, for Phantasy Star, the English ROM with FM sound was patched incorrectly. Someone over at the Rockin' the Classics Discord told me this.

When I last looked at this it definitely had FM sound playing. Though I seem to remember there was issues with the non-FM sound.

Lemongrwab commented 1 year ago

Hi, how to extract rom file from QUBYTE Classics : Thunderbolt Collection By Piko. Im very interested on Thunderbolt II rom file, to see if copy protection is also enabled. I dumped my own copy of genesis cartridge but it unfortunatly copy protected...

arpruss commented 6 months ago

Taito Legends for PS2 has all the ROMs and other emulator files in FILES.HDR and FILES.DAT.

Get this (Unixy) package: https://github.com/arpruss/taito-legends-ps2-extract

Put FILES.* into the taito/ subdirectory.

Then running taito-2003.sh will extract all the files into taito/extract/* and generate zip files (for mame2003, as that's what I have on my RPI 3, but they may work on newer versions) for many of the games. Due to DMCA and/or technical reasons, I omitted games that use copy protection chips.

The following seem to all work: bshark.zip colony7.zip contcirc.zip elevator.zip exzisus.zip gladiatr.zip gsword.zip invadpt2.zip jungleh.zip ninjak.zip othunder.zip phoenixt.zip plotting.zip plumppop.zip rastan.zip sitv.zip spacegun.zip thundfox.zip tubeit.zip volfied.zip

stuckinstyx commented 5 months ago

Taito Legends for PS2 has all the ROMs and other emulator files in FILES.HDR and FILES.DAT.

Get this (Unixy) package: https://github.com/arpruss/taito-legends-ps2-extract

Put FILES.* into the taito/ subdirectory.

Then running taito-2003.sh will extract all the files into taito/extract/* and generate zip files (for mame2003, as that's what I have on my RPI 3, but they may work on newer versions) for many of the games. Due to DMCA and/or technical reasons, I omitted games that use copy protection chips.

The following seem to all work: bshark.zip colony7.zip contcirc.zip elevator.zip exzisus.zip gladiatr.zip gsword.zip invadpt2.zip jungleh.zip ninjak.zip othunder.zip phoenixt.zip plotting.zip plumppop.zip rastan.zip sitv.zip spacegun.zip thundfox.zip tubeit.zip volfied.zip

Thanks for this. This should probably be split into a separate issue so it is not hidden in this thread.

I had to edit your script a little bit to make it work. taito-2003.sh tries to call taito-extract.sh where it should be calling taito-extract.py

The script also assumes that the filesname are allcaps.

I looked at the PS2 sequel, Taito Legends 2, but the files seem to be in a very different format.

aperrien commented 4 months ago

Sega Mega Drive Ultimate Collection/Sonic's Ultimate Genesis Collection (Xbox 360)

Mega Drive/Genesis and Master System These games are contained within the /flog_U.fpg file. They're almost all available in easier ways (Sega Mega Drive Collection on Steam) but it does contain Golden Axe Warrior which is quite expensive to pick up in the UK, To extract do the following:

  1. On the Xbox 360 install the CD to an external USB drive or move your already installed/downloaded file to an external USB drive.
  2. On the PC use God2ISO to convert the Xbox 360 format to an ISO.
  3. Use gxISO to extract this ISO.
  4. Download these two scripts func_getTYPE and XBLA flog_x360.fpg extractor.
  5. Use QuickBMS with the XBLA flog_x360.fpg extractor script to extract flog_U.fpg.

The func_getTYPE and XBLA flog_x360.fpg extractor scripts are missing now that Xentax forums have shut down. Does anyone have a link to these files? Or better yet, a copy of them?

hadess commented 4 months ago

The func_getTYPE and XBLA flog_x360.fpg extractor scripts are missing now that Xentax forums have shut down. Does anyone have a link to these files? Or better yet, a copy of them?

func_getTYPE.bms isn't on the Wayback Machine:

You do not have the required permissions to view the files attached to this post.

But maybe: https://github.com/clowd81/rift_datamine_tools/blob/master/Audio%20Tools/func_getTYPE.bms matches.

The XBLA flog_x360.fpg is available though: http://web.archive.org/web/20210725211747/https://forum.xentax.com/viewtopic.php?f=13&p=70600 and here for convenience XBLA flog_x360.fpg.txt

aperrien commented 4 months ago

https://github.com/clowd81/rift_datamine_tools/blob/master/Audio%20Tools/func_getTYPE.bms

is pretty good, and I can see the pattern that the application uses now, but it would be nice to have a copy that's newer than the 2016 version. I think I can bodge Sega header information into this code, though.

http://web.archive.org/web/20210725211747/https://forum.xentax.com/viewtopic.php?f=13&p=70600 and here for convenience XBLA flog_x360.fpg.txt

I'll have to look over the QuickBMS documentation to understand this though. It's not clear to me where the encoding is happening.

has207 commented 4 weeks ago

Here's an updated bms script that will extract just the game roms:

# Extracts roms from Sonic's Ultimate Genesis Collection
# The file you need to give quickbms is called flog_U.fpg

# Usage: quickbms.exe <this file> flog_U.fpg <output dir>

idstring "30GF"
get FILES long
goto 0x800

# Define the list of file name mappings
set fileMapCount 0

# Add mappings (original CRC, new name)
# Add mappings (original CRC, new name with .bin extension)
math fileMapCount + 1
putarray 0 fileMapCount "0df12588"
putarray 1 fileMapCount "Golden Axe Warrior.sms"

math fileMapCount + 1
putarray 0 fileMapCount "48884c4a"
putarray 1 fileMapCount "Phantasy Star.sms"

math fileMapCount + 1
putarray 0 fileMapCount "d2cef0b2"
putarray 1 fileMapCount "Alex Kidd in the Enchanted Castle.bin"

math fileMapCount + 1
putarray 0 fileMapCount "691d01e5"
putarray 1 fileMapCount "Alien Storm.bin"

math fileMapCount + 1
putarray 0 fileMapCount "91bcd5dc"
putarray 1 fileMapCount "Altered Beast.bin"

math fileMapCount + 1
putarray 0 fileMapCount "bfd1b156"
putarray 1 fileMapCount "Beyond Oasis.bin"

math fileMapCount + 1
putarray 0 fileMapCount "bba01895"
putarray 1 fileMapCount "Bonanza Bros.bin"

math fileMapCount + 1
putarray 0 fileMapCount "2e2d5ed2"
putarray 1 fileMapCount "Columns.bin"

math fileMapCount + 1
putarray 0 fileMapCount "47d03263"
putarray 1 fileMapCount "Comix Zone.bin"

math fileMapCount + 1
putarray 0 fileMapCount "89ba1583"
putarray 1 fileMapCount "Decap Attack.bin"

math fileMapCount + 1
putarray 0 fileMapCount "590b6f98"
putarray 1 fileMapCount "Dr. Robotnik's Mean Bean Machine.bin"

math fileMapCount + 1
putarray 0 fileMapCount "0dd51252"
putarray 1 fileMapCount "Dynamite Headdy.bin"

math fileMapCount + 1
putarray 0 fileMapCount "21e0e58e"
putarray 1 fileMapCount "Ecco The Dolphin.bin"

math fileMapCount + 1
putarray 0 fileMapCount "0afa7c4f"
putarray 1 fileMapCount "Ecco The Tides of Time.bin"

math fileMapCount + 1
putarray 0 fileMapCount "21948537"
putarray 1 fileMapCount "ESWAT City Under Siege.bin"

math fileMapCount + 1
putarray 0 fileMapCount "66233766"
putarray 1 fileMapCount "Fatal Labyrinth.bin"

math fileMapCount + 1
putarray 0 fileMapCount "6604ae94"
putarray 1 fileMapCount "Flicky.bin"

math fileMapCount + 1
putarray 0 fileMapCount "f018d3db"
putarray 1 fileMapCount "Gain Ground.bin"

math fileMapCount + 1
putarray 0 fileMapCount "27841d73"
putarray 1 fileMapCount "Golden Axe.bin"

math fileMapCount + 1
putarray 0 fileMapCount "93f686b7"
putarray 1 fileMapCount "Golden Axe II.bin"

math fileMapCount + 1
putarray 0 fileMapCount "adf1de30"
putarray 1 fileMapCount "Golden Axe III.bin"

math fileMapCount + 1
putarray 0 fileMapCount "e0a6e83a"
putarray 1 fileMapCount "Kid Chameleon.bin"

math fileMapCount + 1
putarray 0 fileMapCount "e01fb428"
putarray 1 fileMapCount "Phantasy Star II.bin"

math fileMapCount + 1
putarray 0 fileMapCount "2cb5b4b6"
putarray 1 fileMapCount "Phantasy Star III Generations of Doom.bin"

math fileMapCount + 1
putarray 0 fileMapCount "0f7afc9f"
putarray 1 fileMapCount "Phantasy Star IV The End of the Millennium.bin"

math fileMapCount + 1
putarray 0 fileMapCount "cb7685de"
putarray 1 fileMapCount "Ristar.bin"

math fileMapCount + 1
putarray 0 fileMapCount "af668ad2"
putarray 1 fileMapCount "Shining Force.bin"

math fileMapCount + 1
putarray 0 fileMapCount "b7417eea"
putarray 1 fileMapCount "Shining Force II.bin"

math fileMapCount + 1
putarray 0 fileMapCount "6c989b89"
putarray 1 fileMapCount "Shining In The Darkness.bin"

math fileMapCount + 1
putarray 0 fileMapCount "ef96e43f"
putarray 1 fileMapCount "Shinobi III Return of the Ninja Master.bin"

math fileMapCount + 1
putarray 0 fileMapCount "517af466"
putarray 1 fileMapCount "Sonic the Hedgehog.bin"

math fileMapCount + 1
putarray 0 fileMapCount "fe5d9cb5"
putarray 1 fileMapCount "Sonic the Hedgehog 2.bin"

math fileMapCount + 1
putarray 0 fileMapCount "22eac461"
putarray 1 fileMapCount "Sonic the Hedgehog 3.bin"

math fileMapCount + 1
putarray 0 fileMapCount "e1ba6b18"
putarray 1 fileMapCount "Sonic & Knuckles.bin"

math fileMapCount + 1
putarray 0 fileMapCount "24caaed7"
putarray 1 fileMapCount "Sonic 3D Blast.bin"

math fileMapCount + 1
putarray 0 fileMapCount "452d0db2"
putarray 1 fileMapCount "Sonic Spinball.bin"

math fileMapCount + 1
putarray 0 fileMapCount "6a2d5024"
putarray 1 fileMapCount "Streets of Rage.bin"

math fileMapCount + 1
putarray 0 fileMapCount "1c74b8cd"
putarray 1 fileMapCount "Streets of Rage 2.bin"

math fileMapCount + 1
putarray 0 fileMapCount "ba03b379"
putarray 1 fileMapCount "Streets of Rage 3.bin"

math fileMapCount + 1
putarray 0 fileMapCount "4b2fe734"
putarray 1 fileMapCount "Super Thunder Blade.bin"

math fileMapCount + 1
putarray 0 fileMapCount "30a7e996"
putarray 1 fileMapCount "VectorMan.bin"

math fileMapCount + 1
putarray 0 fileMapCount "1bbd7057"
putarray 1 fileMapCount "VectorMan 2.bin"

math fileMapCount + 1

for i = 1 <= FILES
    get NAME_CRC long
    string NAME_CRC p= "%08x" NAME_CRC
    get OFFSET long
    get SIZE long
    get ZSIZE long

    # Check if the current NAME_CRC matches any in the file map
    set NAME ""
    for j = 0 < fileMapCount
        getarray CRC 0 j
        if CRC == NAME_CRC
            getarray NAME 1 j
            break
        endif
    next j

    # If a match is found, proceed with extraction
    if NAME != ""
        if SIZE == ZSIZE
            putVarChr MEMORY_FILE SIZE 0
            log MEMORY_FILE 0 0
            log MEMORY_FILE OFFSET SIZE
        else
            putVarChr MEMORY_FILE ZSIZE 0
            log MEMORY_FILE 0 0
            clog MEMORY_FILE OFFSET SIZE ZSIZE
            set SIZE ZSIZE
        endif

        log NAME 0 SIZE MEMORY_FILE
    endif
next i

startfunction getTYPE
    getdstring TYPE 4
    if TYPE == "TYPE"
        getdstring ZNAME 20
        string EXT = ".bin"
    else
        string ZNAME = ""
        string EXT = ".dat"
    endif
endfunction

Btw, maybe an easier way to get the flog_U.fpg file is to "install" the game files with Xenia-canary. Basically grab the files from your 360 as described above, but instead of converting to ISO, etc. simply do File/Install from xenia-canary and you'll find the extracted files in your Documents/Xenia/content folder. Then need to save the above code as sonic.bms or whatever you want and run quickbms.exe specifying this file and flog_U.fpg