aldostools / IRISMAN

All-in-one backup manager for PlayStation®3. Fork of Iris Manager.
GNU General Public License v3.0
233 stars 22 forks source link

default copy new files only #26

Open retrosapien opened 3 years ago

retrosapien commented 3 years ago

Is it possible to add an option to only update missing/incomplete files when copying? Or a dialog to skip or overwrite? I could be wrong, but i think currently it overwrites by default. If it is easier to implement in webman mod's web/ftp server that could work to. [Edit] I just noticed the subtle /copy_ps3 vs copy.ps3 command difference.

;tldr Backing up my files in preparation for a new hdd has been driving me crazy. I tried using a lexar 128gb usb 3 flash drive formatted to ntfs. I didn't want to use fat32, as i wasn't sure if i would need to transfer files greater than 4gb. Anyway, half way through the transfer i was getting an error. i tried to re-copy the same set of files, because i didn't know where it left off, as there were missing directories in random spots in the list, not just at the end. I think the program does a check for disc space before transferring, as it gave an error. (if it was copying to a new location, there wouldn't be enough space, but if only updating missing files it would have been fine.) So i tried to go one folder at a time, which was very time consuming, until i got another error about permissions i think. I powered down and used chkdsk /r on the flash drive on my laptop. (corrupted index i think)

aldostools commented 3 years ago

Feature was added to the latest commit.

Download the latest PKG again.

retrosapien commented 3 years ago

Re-Downloaded and installed latest package, but I didn't see anything different with the copy feature.

Is there a setting I need to enable? Or rebuild database maybe?

EDIT; It is definitely overwriting and NOT updating files. I just checked the file dates over ftp. All the folders have the date 2021-01-25, and all the files have the date 2021-02-02(which is tomorrow's date, strangely enough)

TL;DR There is one difference I'm noticing. I just backed up my HDD home folder over my old USB (fat32 this time) home folder. It says 100% on both progress bars, but the bottom one is stuck on a PARAM.SFO file, and the end of the green bar keeps flickering back and forth from almost done to done. Can't tell if it is the same files or multiple files, named the same.

EDIT; it must have been multiple instances of the same named file. It briefly changed to a different filename. I imagine the system must have a hell of a lot of param.sfo files. ;-) Maybe the progress page could show the path, too? Or not show 100% when it's not finished. ;-) Still better than a windows progress dialog. Lol I think if it was just updating the files, it should be done by now. Maybe a file count fraction might be a better progress indicator? Something like 100 / 1000 files copied, or left to copy? Or just show the numbers. Nothing to translate then.

EDIT; it finally finished. So I ran it again to see if it was updating or overwriting. Hard to tell with the current progress bar. Almost immediately, it said 100%, top and bottom. Maybe it is updating, but iterating all the file s to check for dates and file size? Maybe you could explain better what is happening in the background. Because to the untrained, impatient eye, the transfer appears finished. Probably because of all the param.sfo files.

aldostools commented 3 years ago

In the menu of the File Manager you will see a Copy option. If you press LEFT/RIGHT the option changes to Shadow Copy, Update/Copy or Zip Folder.

If you select Update/Copy, it performs the same actions as the Copy option, except that it compare the file size of the source and target files. If the file size is the same, the copy is ignored and continue with the next file. If the file in target path does not exist or has a different file size, the copy is performed.

The Shadow Copy works only when you copy files between folders in HDD0. Instead of copy the file (read source file & write to the target path), the source file is linked in the target path.

retrosapien commented 3 years ago

Ok. I see that now.

Maybe some arrows could help make it more intuitive for users. I didn't even think of that. Now I'm pressing the Left and Right on all the menu items looking for other hidden options. Lol

Just seen the mount and permissions options with help from your advice. What permissions are set with that option btw?

I'm going to do some tests, because it feels like update copy is taking just as long as regular copy. Probably because the progress indicator is echoing every filename. Maybe it's just that way with smaller files.

Is there anyway to preserve original time stamp of files when copying?

Also, the paste option is always gray. How is that used? How do I fill the paste buffer?

Sent from my Samsung Galaxy smartphone.

-------- Original message -------- From: aldostools notifications@github.com Date: 2021-02-02 8:10 AM (GMT-05:00) To: aldostools/IRISMAN IRISMAN@noreply.github.com Cc: retrosapien timgmooney@hotmail.com, Author author@noreply.github.com Subject: Re: [aldostools/IRISMAN] default copy new files only (#26)

In the menu of the File Manager you will see a Copy option. If you press LEFT/RIGHT the option changes to Shadow Copy, Update/Copy and Zip Folder.

If you select Update/Copy, it performs the same actions as the Copy option, except that it compare the file size of the source and target files. If the file size is the same, the copy is ignored and continue with the next file. If the file in target path does not exist or has a different file size, the copy is performed.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/aldostools/IRISMAN/issues/26#issuecomment-771623304, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AMGBSWMVEKWPUXUTGHM64YTS472SNANCNFSM4WXWDDNA.

aldostools commented 3 years ago

Permissions are 0777 (read write execute).

I love to add hidden features as easter eggs ;-)

LOL I didn't remember there was a Copy/Paste... I barely touch IRISMAN, since my main project is webMAN MOD.

About a way to keep the original time stamp, there should be a way changing the file date/time after copy, but that would be extra coding and extra processing time.

retrosapien commented 3 years ago

What would be an example of the permissions needing to be fixed? How do you even read the permissions on the ps3? There isn't exactly a ls command is there?

Easter eggs are definitely fun to find.

I usually just use webman mod, as well. Some things need a bit more control, though.

How does shadow copy work? I've never used the original.

Probably not possible to implement a rsync type backup, but that would be ideal.

I can't remember, are you the dev for hen toolbox? Have you ever used the back up utility from those tools? Or the Sony version?

What I'd really like is to just clone the drive to a bigger drive and then re size the HDD partition. But from what I've read, that isn't posible; Yet.

Sent from my Samsung Galaxy smartphone.

-------- Original message -------- From: aldostools notifications@github.com Date: 2021-02-02 4:40 PM (GMT-05:00) To: aldostools/IRISMAN IRISMAN@noreply.github.com Cc: retrosapien timgmooney@hotmail.com, Author author@noreply.github.com Subject: Re: [aldostools/IRISMAN] default copy new files only (#26)

Permissions are 0777 (read write execute).

I love to add hidden features as easter eggs ;-)

LOL I didn't remember there was a Copy/Paste... I barely touch IRISMAN, since my main project is webMAN MOD.

About a way to keep the original time stamp, there should be a way changing the file date/time after copy, but that would be extra coding and extra processing time.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/aldostools/IRISMAN/issues/26#issuecomment-772009597, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AMGBSWNZY65M6KDRU3326VLS5BWMRANCNFSM4WXWDDNA.

aldostools commented 3 years ago

Some files are created with read-only permissions. The fix let read/write. The permissions are read using cellFsStat (FTP should show the permissions). They are changed with cellFsChMod. These are commands of the SDK.

Shadow copy uses symbolic links to create a copy of the file. That is 2 or more directory entries pointing to the same inodes (disk sectors containing the file data). This is faster because there is not data copied, only the directory entries. It only works when copying from one folder to another in HDD0.

The developer of HEN was Habib from Rebug Team. He based it on the exploit developed by bguerville. IIRC The HEN Toolbox was created by DeViL303.

AFAIK it is not possible to clone a HDD. You need to copy the files to a backup media, then restore in the new HDD.

retrosapien commented 3 years ago

Hmm...

So shadow copy is like a soft link on Linux? Will deleting one, the link or the file, delete the other?

I could see some uses for this with covers and roms. And other large data sets.

Will the ps3 see the space savings? Or will it just count it as twice the space used on the disk?

Does the link "have" to be on the same disk/partition? Obviously it won't work when the drive is removed, but could a file reside on USB, and the link on the HDD ?

I can't remember if there are still files that "must" be on HDD, but if that is possible, it could circumvent that limitation.

Ah, yes. You and DeViL303 have that same green name colour on your posts, so I often get them confused. Lol.

From what I've read it is possible to clone, just not much of use can be done after that.

I'm sure someone has already had all these thoughts before, but it's still interesting to discuss. Thank you.