search

Skallwar / suckit

Suck the InTernet
Apache License 2.0
748 stars 39 forks source link

Make URL Processing optional #211

Open aidik opened 1 year ago

aidik commented 1 year ago

It would be nice to have the ability to indicate whether or not URLs should be processed for offline browsing. This change will make SuckIT a more versatile tool for static page generation and allow its integration into more toolchains.

Skallwar commented 1 year ago

I'm not sure about what a use case would look like. Could you explain a bit more?

aidik commented 1 year ago

Hi @Skallwar,

sure, for example in our environment we compile a static website from multiple local sources, and after that, we push the static files to the CDN. The use of SuckIT will significantly speed up our build process, unfortunately, we can't use it because it insists on URL processing.

Essentially I'm looking for an equivalent of httrack's --keep-links=4

Thank you for considering

Skallwar commented 1 year ago

Oh I think I get it. The idea would be to download the website without modification.

It should be simple enough to implement I think.

I don't have much time right now so I can't give an ETA but I will gladly take a look and merge a PR adding this feature.