davidfstr / Crystal-Web-Archiver

Downloads websites for long-term archival.
http://dafoster.net/projects/crystal-web-archiver
59 stars 5 forks source link

Dynamic Browsing: Support dynamic download of site entirely through browser #69

Open davidfstr opened 2 years ago

davidfstr commented 2 years ago

Currently Crystal is designed for the user to use the GUI to both (1) define URLs and URL patterns to download and (2) request that these URLs actually be downloaded. Then with the URLs already downloaded the user can start Crystal's server and browse them.

It would be nice to support a workflow where the user immediately starts Crystal's server and interactively browses to webpages that are desired to be downloaded. Whenever trying to visit an HTML page that isn't downloaded, Crystal should offer an in-browser UI to interactively create a new Root Resource or Resource Group to download the new page.

Such an interactive browser-based means of downloading a site is likely to be more intuitive that the current GUI-based approach, especially for a browser-based login workflow.

Outcomes:

davidfstr commented 2 years ago

Prior thinking on such a workflow: IMG_2951-B IMG_2952 IMG_2953