shinrax2 / PS3GameUpdateDownloader

downloader for ps3 game updates (.pkg files) from official sony servers written in python
GNU General Public License v3.0
120 stars 11 forks source link

Is it multi-threaded to download the update file? #7

Open RuralHunter opened 3 years ago

RuralHunter commented 3 years ago

I mean to accelerate the download speed.

shinrax2 commented 3 years ago

its on my todo list but might take some time til i get around to write it

rursache commented 9 months ago

any plans on this @shinrax2 ? I'm trying to dump around 5TB of patches for my archive but the speed using your software is capped at around 9-10MB/s. using jdownloader with the links exported from your app downloads the files at 150-180MB/s (close to my internet cap). you can see how much of a difference this makes. unfortunately if i use jdownloader i would have to rename the files myself :(

thanks!

shinrax2 commented 9 months ago

@rursache im quite busy right now but might be able to get something working in the next weeks but no promise export feature was also more of bandaid

does jdownloader have any capabilities to import something like a csv with predefined names for the files? it would be quite trivial to expand the export feature to support that

rursache commented 9 months ago

@shinrax2 does jdownloader have any capabilities to import something like a csv with predefined names for the files? it would be quite trivial to expand the export feature to support that

i think they do? https://board.jdownloader.org/showthread.php?t=67474

thanks!

shinrax2 commented 9 months ago

@rursache ive expaned the exporter

to use it set up jdownload like this

add a new packetizer rule If-> SourceUrl, contains, .*ww.np.dl.playstation.net.*#name=(.+), Enable regex Then-> Filename, <jd:source:1>

to use the expanded exporter you need to be on the latest git commit if you absolutely need a binary release and cant bulit it your self let me know

rursache commented 9 months ago

@shinrax2 thanks for the help!

I grabbed the latest git commit, ran the GUI (on Windows) and tested with BLES01807 (GTA V). exported the queue file that contains this URL:

http://b0.ww.np.dl.playstation.net/tppkg/np/BLES01807/BLES01807_T29/45755cadf6f036f0/EP1004-BLES01807_00-GTAVTITLEUPDATER-A0106-V0100-PE.pkg#name=Grand%20Theft%20Auto%20V%20%28PAL%29_%5BBLES01807%5D_01.06.pkg

I setup the rule in jdownloader: jdownloader rule I pasted the URL in jdownloader and started the download and for it to finish.

The result is as before, a folder named EP1004-BLES01807 00-GTAVTITLEUPDATER-A0106-V0100-PE with a EP1004-BLES01807_00-GTAVTITLEUPDATER-A0106-V0100-PE.pkg file inside.

Seems like some jdownloader rule issue?


EDIT: For some reason the regex box wasn't checked, weird UI here. It's all working, thanks!

shinrax2 commented 9 months ago

@rursache you need to check the checkbox on the right of the sourceurl line to enable regex

shinrax2 commented 9 months ago

in case somebody wants to do the same i added a jdownloader preset rule in 7850190a122887116877790aecc4b932aeabc613 for that

rursache commented 9 months ago

@shinrax2 please take a look at my pull request, i improved multiple things + fixed the slow download speeds

https://github.com/shinrax2/PS3GameUpdateDownloader/pull/112

rursache commented 9 months ago

@shinrax2 I wrote my own python script to better and faster download many patches without using jdownloader. please take a look at this class as this will fix this open issue. I can saturate my 2gbps link when running my script. good luck!

shinrax2 commented 9 months ago

@shinrax2 I wrote my own python script to better and faster download many patches without using jdownloader. please take a look at this class as this will fix this open issue. I can saturate my 2gbps link when running my script. good luck!

cool gonna take that as inspiration for my implementation with credit of course (gotta change some stuff due to how PS3GUDs gui works)