Conal-Tuohy / TroveProxy

A transforming proxy and harvester for the National Library of Australia's Trove API
Apache License 2.0
2 stars 0 forks source link

Adds a "harvester" application at /harvester/harvest/ #29

Closed Conal-Tuohy closed 10 months ago

Conal-Tuohy commented 10 months ago

There should be a home page for the app at /harvester/ but there isn't (yet). The URL /harvester/harvest/ shows a list of existing harvests and a form where you can add a new one.

But in general my intention is that it would be integrated by having some other JS code make an HTTP POST to /harvester/harvest/ with www-form-urlencoded parameters url being a query URL (of the proxy) and name being a name for a new harvest. The result is returns a returns a redirect to an HTML page representing the harvest, e.g. /harvester/harvest/my%20harvest/. You can refresh the page and see the harvesting going on in the background. You can see a list of the harvested files, and download them directly.