search

hueyyeng / VesperiaTools

Trello: https://trello.com/b/2knLdpCb/vesperiatools
2 stars 1 forks source link

Missing DAT and SVO functions in GUI #8

Closed hueyyeng closed 3 years ago

hueyyeng commented 3 years ago

image

Need to implement Unpack DAT and Extract SVO in GUI. Raised by https://github.com/Gunlaus

hueyyeng commented 3 years ago

@Gunlaus I'll need time to review my changes for improvements to allow recursive unpack DAT and extract SVO before I merge into develop branch.

Do checkout to this branch if you want to test it out: https://github.com/hueyyeng/VesperiaTools/tree/feature/VT-4-add-unpack-data-extract-svo-to-gui

Gunlaus commented 3 years ago

I just did a test file, and was given this error

System.Exception: zlib based tlzc compression currently unavailable, use revision https://github.com/AdmiralCurtiss/HyoutaTools/tree/525209cc0ada7d54f1a67f6f82c28c3e6cd0f722 for now at HyoutaTools.Tales.tlzc.TLZC.Compression2.Decompress(Byte[] buffer) in D:\HyoutaTools\Tales\tlzc\TLZC.cs:line 78 at HyoutaTools.Tales.tlzc.tlzcmain.Execute(List1 args) in D:\HyoutaTools\Tales\tlzc\tlzcmain.cs:line 58`

hueyyeng commented 3 years ago

Which DAT file do you test with? The error relates to HyoutaTools TLZC compression but I just compiled the latest HyoutaTools commit to ensure I did not hit any regression.

I did several tests and it works fine on my end. Refer to screenshots.

image

image

How are you compiling the HyoutaTools? I recommend git clone the repo using the latest master branch and don't forget to run git submodule update --init --recursive in HyoutaTools folder as AdmiralCurtiss move out some of the code into different repos.

Ah I see you have open an issue at HyoutaTools.

My suggestion is to at least install Git for Windows and learn the basics of git clone and checkout. It will be easier to troubleshoot the issues if we're on the same page and if you're already eager to learn ESRGAN for model training, this will be the first step in exploring more interesting GitHub repository on AI upscaling!

Gunlaus commented 3 years ago

I would like to thank you with all my heart for your help. This has been incredibly frustrating for me but I have finally reached the end of the road (With good results!). I have successfully unpacked map.svo and got ALL the textures from it. I just want to confirm with you one last time, that IS the only place with background textures correct? My dataset needs as much as I can get.

I'd like to also clear some things out, I do have git installed (In fact, I needed/used it for esrgan) but I just figured manually downloading would produce the same result. Somehow I kept messing up the directories one way or another and I couldn't figure out what's going on. A switch to git made all of my problems disappear. I was even able to pull the textures using CLI!

I can finally relax.

(Sanity check/ verify check: I've pulled 4897 textures files from map.svo)

hueyyeng commented 3 years ago

If you're looking for the background environment textures, map.svo should be the one stop place.

chara.svo is obviously for the characters model. Can't say I've scoured every nook and gritty of the game packages since the dev duplicated some of the assets in different packages to speed up the load time as mentioned before.

Using git is preferred when dealing with versioned controlled codes as downloading multiple ZIPs of the repo is tedious (for me anyway).

I'll still leave this issue open up first until I get the recursive feature working. I saw AdmiralCurtiss wrote a function to recursively unpack the TXM/TXV files but I prefer if the user have specific DAT files that they want to unpack instead of the whole SVO package.

hueyyeng commented 3 years ago

Decided to skip recursive unpack since it opens up a whole new can of if else worms.

eggkershall commented 1 year ago

How do I get that program running, do I click the main.py? itdoesn;t seem to work for me

hueyyeng commented 1 year ago

How do I get that program running, do I click the main.py? itdoesn;t seem to work for me

You will need to follow this steps: https://github.com/hueyyeng/VesperiaTools#running-vesperiatools

eggkershall commented 1 year ago

sorry if I sound like a noob, but do I need to use it from the command prompt? is so, then it just fives me a error and closes

hueyyeng commented 1 year ago

Yes you will need to run it from the command prompt and also have Python 3.8 or newer installed.

I just tested steps provided and it is working on my side.

eggkershall commented 1 year ago

So I got VesperiaTools running but it asking for HyoutaToolsCLI.exe

so where would I get it?

hueyyeng commented 1 year ago

I believe you downloaded the tag release which is not the latest code as I already remove HyoutaToolsCLI.exe dependencies from my latest develop branch.

Can you download this and replace the existing files?

image

eggkershall commented 1 year ago

so I got the program running but I don't know how to extract it, althou not sure how to get the textures so did I miss something?

hueyyeng commented 1 year ago

so I got the program running but I don't know how to extract it, althou not sure how to get the textures so did I miss something?

I'll need more details on what you have already attempted. The textures (which is DDS format if I recall correctly) is from TXM files that is packaged in DAT files. Try this:

  1. Unpack the .DAT files
  2. I think you'll need to unpack it again as it it will be .DAT.dec
  3. There will be many folders which you can find the TXM files
  4. Use Extract Textures from TXM/TXV to get the texture files

Reminder that I'll need you to at least described what you have attempted or I'll not provide further assistance as this tools is provided as it and meant for those who really want to inspect Vesperia file contents. Yes it can be frustrating without a guide but that goes without saying for most game ripping tools out there.

eggkershall commented 1 year ago

Sorry for not being detailed earlier, I want to know does it work on the PC or PS3 ver,, and where would it be extracted to cuz I tried it and it seems like nothing happen or I dunno where its extracted to, and also if this is only for the PS3, what the chance that it can extract the DLC costumes? hope that enough

hueyyeng commented 1 year ago

I only tested it with the PC version but I remember tested it for PS3 version too.

As I cannot share the game files, I'll later check again on my side.

On Sat, Jan 21, 2023, 12:04 PM eggkershall @.***> wrote:

Sorry for not being detailed earlier, I want to know does it work on the PC or PS3 ver,, and where would it be extracted to cuz I tried it and it seems like nothing happen, and also if this is only for the PS3, what the chance that it can extract the DLC costumes? hope that enough

— Reply to this email directly, view it on GitHub https://github.com/hueyyeng/VesperiaTools/issues/8#issuecomment-1399171529, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADY4YF64Q6PHGR3MJMA7L6LWTNN5RANCNFSM4ZFWD4EA . You are receiving this because you modified the open/close state.Message ID: @.***>

eggkershall commented 1 year ago

well no need to share the files, I already got them, I just need to know where would it be extracted from SVO and DAT files

hueyyeng commented 1 year ago

image

@eggkershall Can you try download the latest develop branch and replace your existing copy (or if you're already familiar with git, just git pull develop). I made a minor tweak to the way textures and material are handled.

You can try FORT00.DAT from map.svo and see if it matches like my screenshot. Take note there are "dummy files" for the lack of better term where you'll not be able to extract any textures despite being detected as TXV files.