Qestion for help straight for @Johndrinkwater

GTPunk commented 6 years ago

so,i want to export all models and textures for example from basic_apartment_evening_T037.sdat (harbour studio). What i need to do? i googled how to decrypt sdat to dat but what to do next? contentID and what-not,im not familiar with ps3 things.can you help me?

MercuryValentine commented 6 years ago

Here are the two developer versions I've acquired. NPIA00010 is the full developer version, and while NPEA00013 was the closed beta, it seems they reused the ID and made it for content developers after the closed beta ended. Functionally, they seem to be identical as far as I can tell. You can run them on CFW by copying them to your PS3 and rebuilding the database.

@RedFox102 That would make sense. All the unencrypted SDC files I have are just XMLs with references to local directories and content, which also fits with why only the developer EBOOT referenced an SDC file in offline mode. That would certainly suck, since as you said, the chances of getting the HDK are small. And having it would make reverse engineering all the filetypes a cinch too.

In terms of numbers, there were actually quite a lot of solo developers and companies that temporarily worked on Home, but obviously they likely wouldn't have it anymore, even if they were generous enough to leak it. I'm surprised Cubehouse/Jamie Holding contributed to this archive, with no lashback from Sony at that.

IDelirious commented 6 years ago

@GTPunk .... im farely intrsted in your work... jave u tried recreating any other maps?

GTPunk commented 5 years ago

@IDelirious actually i working on new version. here it is https://yadi.sk/d/eOL2O5ah3abmZF there are 'you are not supposed to see this' rock as a chair, and also i planned an menu here. @MercuryValentine can you export basic character textures for me please? i am already exported model of basic player from four kings, and i think to retexture it to psh one Edit/Update: also i found in VRChat a guy called Canaha who created 'home square' map, and it looks 100% like original.

GTPunk commented 5 years ago

i've released PSHome map at vrchat. its public. there are tv and ps4 from quest for greatness (i combined videos in one to play on it, but sony blocks it in some countries, such as us =( ).

IDelirious commented 5 years ago

@GTPunk thats fantastic!! can you send me the unity project with it inside?..... i wanna see if there is anything i could do to improve on it

GTPunk commented 5 years ago

@IDelirious give me your contacts, facebook, steam, mail, something

IDelirious commented 5 years ago

my email is 29jhamon@gmail.com ... you can find me there

On Sun, Sep 2, 2018, 8:28 AM GTPunk notifications@github.com wrote:

@IDelirious https://github.com/IDelirious give me your contacts, facebook, steam, mail, something

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/johndrinkwater/ps-home-archive/issues/1#issuecomment-417930881, or mute the thread https://github.com/notifications/unsubscribe-auth/Afg4IYF3e3f7nG43fJDSt34y-DDeZM9iks5uW9zfgaJpZM4RbIi5 .

GTPunk commented 5 years ago

@IDelirious check your spam if you doesn't have it

GTPunk commented 5 years ago

@MercuryValentine i've tryed to export player files myself with offzip,but this exports like this https://i.imgur.com/BwVshfb.png can u help please?

GTPunk commented 5 years ago

@RedFox102 'offline mode' (x,triangle,square ect) is stands for this menu https://i.imgur.com/BPmsk7B.png idk what comands uses console. maybe its possible to emulate that hubps3.online.scee.com? maybe its possible to view maps thru that cososole? what else is possible with that developer build?

RedFox102 commented 5 years ago

@GTPunk That's a new one to me, I never tried with a version that old. Does anything actually happen when you open the console? I did have a short list of commands at some point, which I'm sure included something about loading scenes, but I never got to try any of them because I never got the console to open.

The old developer conferences that are still available online point to the HDK being a requirement though, so I assume you'd just get an error when you try to actually load something in offline mode, even if it's just harbor studio. I think we have a better chance of finding someone who can break the encryption though. X3

GTPunk commented 5 years ago

@RedFox102 yeah console opens. but i cant type anything in rpcs3. try just now that developer versions that mercury valentine uploads. maybe you will succeed on those https://i.imgur.com/aY7WGDd.png

GTPunk commented 5 years ago

@RedFox102 what console comands do you know? i found this picture https://twitter.com/Pongo86_/status/933307848095879168

RedFox102 commented 5 years ago

@GTPunk Sorry, I don't remember any of them, nor do I remember where I found them in the first place. Literally all of my knowledge on this stuff is coming from old forum posts, YouTube videos, and the old home dev conference's, so I'm in the same boat as you are.

Seems like you have a pretty good lead on twitter though. One of their other posts mentions using Maya, and I think that there was a plug-in (Extension? Script? I've never used Maya) that was used for exporting the model's for use in home, I wonder if the same plug-in could import the files we have. Maybe you'll get a response from them, let us know. X3

snakescater commented 5 years ago

I think the only way now is to find a former content developer who is willing to shed light on this subject. Need to keep looking for individuals who post things about this, and just ask them. There has to be at least one person who can help out.

MercuryValentine commented 5 years ago

Some people I know already contacted Pongo86 and tried booting into Home via the console a few months ago, and it just crashes. If I remember correctly the command was just "home". Running it through ProDG didn't give any obvious hints as to what the exact issue was, however Pongo said that it requires a SELF file (which are hosted on DevNet and fingerprinted), so he isn't willing to share it.

If anyone feels like trying their luck, there are quite a lot of commands usually preceded by the string "SimpleCommand" in the Home binaries. I've scanned through NPIA0005 1.00 and 1.86; haven't found anything pertinent to booting offline though.

RedFox102 commented 5 years ago

That's too bad about Pongo, but I don't blame him a bit, it's not worth ruining a person's life over. At least you got some new information. ^^

Isn't there a command to view individual models? I think I remember seeing something similar on one of the home dev conference videos.

GTPunk commented 5 years ago

@MercuryValentine dude since you are actually answering, can you export player textures?

MercuryValentine commented 5 years ago

@GTPunk You still haven't gotten offzip to work? The textures should be in OBJECTS.bar, but here's the DDS files I had laying around.

GTPunk commented 5 years ago

@MercuryValentine 404 not found @RedFox102 i found 'map name of the scene' comand. but i've tryed some names and it always says no such scene

RedFox102 commented 5 years ago

@GTPunk For harbor, it should be "BasicApartment".

GTPunk commented 5 years ago

@RedFox102 https://i.imgur.com/iUnPLUr.png

RedFox102 commented 5 years ago

@GTPunk Weird, works for me. I mean, it just freezes like MercuryValentine said, but it doesn't throw an error like that. I also don't have an error about a missing scene list, maybe grab the xml from another version and try again? Also, how are you finding commands?

GTPunk commented 5 years ago

@RedFox102 i just remember commands from other games with console.

GTPunk commented 5 years ago

@MercuryValentine 404 reupload please

MercuryValentine commented 5 years ago

@GTPunk Link

GTPunk commented 5 years ago

@MercuryValentine Thank you, there are so many userful stuff!

Kobun42 commented 5 years ago

I found out the reason why the dev build crashes when using map BasicApartment. The server can't get the file from the URL. Perhaps if we did something about that, we'd make a bit of progress into getting there

snakescater commented 5 years ago

Maybe try uploading the necessary files to a host and using the new url?

Kobun42 commented 5 years ago

yes, i've thought of that using a local dns at the moment. as of right now i'm attempting to install the dev pkg. i'll see how that turns out.

Kobun42 commented 5 years ago

Oh, and by the way, for the DEV version, the CACHE folder seems like a mystery to me. It seems undocumented, and that's why I wish we had some insight on how this worked.

RedFox102 commented 5 years ago

I've also thought of that, but doesn't the XML reference scene files which we don't even have to begin with?

Kobun42 commented 5 years ago

as far as i'm aware, yes. I'm not sure how we'd obtain those, but I'm trying to work with what I have.

RedFox102 commented 5 years ago

Well, I assume that the sdat files in the archive are just encrypted scene files, not sure what can be done with them though. You can obviously decrypt them with something like trueancestor, but what you do with the file after that is a mystery to me. I've tried offzip to pull files out of them after decryption, expecting to at least get some textures or something, but I never got anywhere.

Kobun42 commented 5 years ago

yeah, those files are mysteries to me, and I don't know how they're still not documented.

RedFox102 commented 5 years ago

I've thought about uploading a couple decrypted dats and posting about them on a game research forum like xentax, from what I've seen it just doesn't look like anyone would be interested.

Maybe something like the littlebigplanet space would attract attention, being that it has exclusive content not seen anywhere else. There are tons of things like that, the infamous space is another popular one that comes to mind.

Kobun42 commented 5 years ago

well, i wanna take a look at them, if possible, can you link them if possible?

MercuryValentine commented 5 years ago

I've ran multiple various Home files (not quite all) through some tests and they're no doubt all encrypted. There was already a thread asking about the .SHARC files on Xentax, but only the forum owner replied. There's quite a number of cross references to the files' strings, including this in Home's EBOOT, so static analysis might suffice in getting the decryption key.

Kobun42 commented 5 years ago

interesting, i'll see what I can do soon.

Kobun42 commented 5 years ago

As of right now, my current business is to see how the OfflineContent stuff works in the developer version of ps home, because lots of this stuff is unclear, and i'm trying to at least load something. If anyone can provide any details or give me some tips to find it out, that would be appreciated.

GTPunk commented 5 years ago

is arcade on vita have something userful besides the 2d home games?

Kobun42 commented 5 years ago

I think it had some awards, but if that's true, then they're unusable now due to the closure of home.

GTPunk commented 5 years ago

@Kobun42 i mean files obviously

Kobun42 commented 5 years ago

well i'm not sure tbh, never honestly went through it.

MercuryValentine commented 5 years ago

@Kobun42 You can try to boot into offline mode by placing a file called HubStartup.txt in your dev_usb0000 port with the line "contentServerOverride http://your.ip.address.here", and enter "home" into the developer console. As I mentioned above though, it simply crashed the developer versions, the 1.83 dev EBOOT doesn't appear to detect it, and Pongo said it requires a fingerprinted SELF file. Perhaps the "map" command would work.

@RedFox102 Do you happen to know if there actually is a command to view models? That would help Kobun42 with decrypting the files, if the encryption keys aren't findable via IDA.

GTPunk commented 5 years ago

@MercuryValentine so if i just type my ip address in that txt my basicapartment must automaticly visible by game? i dont understand what i need also to do to just view maps on rpcs3

Kobun42 commented 5 years ago

Thank you for the offline mode info. I'll investigate what it does.

Kobun42 commented 5 years ago

Well, I tried the offline mode [especially seeing i'm hosting a custom server via apache] but rpcs3 is the only way I could do it, especially when it can't really install it on my current console [wish to get cfw, but no way for my fw yet] and rpcs3 doesn't have networking capabilities, so it probably would have worked if it had networking. I'm looking into possible alternatives, like the mysterious OfflineContent stuff I've seen.

Kobun42 commented 5 years ago

I almost got cache working! I just looked at the rpcs3 console to see what it was reading, and i've almost got it!

Kobun42 commented 5 years ago

Oh my... the name loaded before freezing! this is it! Screenshot: http://prntscr.com/mz2pvr

johndrinkwater / ps-home-archive

Qestion for help straight for @Johndrinkwater #1