Asnivor / MedLaunch

A Windows (.NET) Front-End for the Mednafen Emulator
http://medlaunch.asnitech.co.uk/
Other
36 stars 6 forks source link

manual download limits #195

Open ghost opened 6 years ago

ghost commented 6 years ago

when scraping a big library replacementdocs blocks you for downloading too much for a period of time.

can a rescrape unscraped manuals option be added to allow someone to complete the manuals without redownloading manuals or having to go 1 by 1?

Asnivor commented 6 years ago

Sounds like a sensible idea. I'll look into it.

ghost commented 6 years ago

I found 2 walk arounds to this so I dont know if its worth your time trying to make a fix.

my initial solution is is a game is missing a manual and you put it in the manual folder manually the launcher will find it. this is awesome cause ou can add walk through and cheat documents too!

other walk around (automatic) you can set the launcher to scrape just manuals, find where it left off, select a range and scrape. next time it stops i record where. then the next day scrap from that range forward.

Having found these two ways to deal with this make me think that its not really needing enhancement maybe just a tip to future users.

BTW:I love this front end. LOVE

Asnivor commented 6 years ago

Thanks :)

Yeah, I designed the the manuals folder mechanism so you could dump whatever you liked in there and it should appear in the UI (although this probably isn't documented anywhere - like most things currently).

I might be able to code something that skips a manual download if the file already exists locally, but iirc, replacement docs has a PHP download system that doesn't reveal the manual filename until the http request has been sent, so this probably wont help reduce the download quota usage.

I'll have to take a look at the local manual scraping database that ships with MedLaunch and see if there is any way around this.

ghost commented 6 years ago

would it be possible to add offline scrape and ftp scrape?

I have a big collection of manuals. offline scrape would make things so easy.

I also ask about ftp scrape because I can setup a server with manuals that I can keep online at a commercial building 24 hrs 7 days with the manuals. Im willing to set this ftp up. let me know.

Asnivor commented 6 years ago

Offline scrape - possibly with a little bit of work. Would have to partial match based on filename and would be further complicated if the filenames did not include the game system they are for.

FTP scrape - that could be quite cool. Although you would need to provide me with a file list (potentially separated into systems) that I could add into the medlaunch scraping database. I might be overhauling the database anyway over the next month or so though, so there is no great rush on this (as I probably wont be able to implement anything for a while).

ghost commented 6 years ago

ok well i have a decent collection of already named and organized by directory of manuals.

I will set up a ftp specifically for medlaunch ( i have where I can put this for nothing and keep it online)

As soon as I set it up I will let you know and if you choose to use it great!

Once this is set up I will come to you with the ftp information and a text file showing the dir structure and file names.

It will be my contribution if its something you and other users are interested in.

Would be kind of cool if I get to help somehow Im getting alot of use from this front end. I like it alot.