search

ukwa / shine

Prototype SOLR-powered web archive exploration UI.
https://github.com/ukwa/shine/wiki
Apache License 2.0
43 stars 7 forks source link

Generate export suitable for Voyant #74

Open anjackson opened 8 years ago

anjackson commented 8 years ago

As discussed under https://twitter.com/ianmilligan1/status/737367313389785088

Look into a suitable export to pass results over to Voyant.

sgsinclair commented 8 years ago

There's an input format for this now defined, instead of defining the individual metadata XPath expressions, we should now be able to use inputFormat=walk

example: http://voyant-tools.org/?input=http://rho.library.yorku.ca:8080/solr/select%3Fq%3Djack%26start%3D0%26rows%3D20%26fl%3Durl,crawl_date,content,title,crawl_year,domain%26wt%3Dxml%26indent%3Dtrue&inputFormat=walk

Note that the input query needs to be escaped to not interfere with the voyant query.

ruebot commented 8 years ago

@anjackson would this (naively asks) be as simple as writing a view along this lines of Csv.scala, with a canned Solr query combined with the Voyant Tools API call?

sgsinclair commented 8 years ago

actually, we've been playing with sending a url, which requires a round-trip, but it's also possible to post multi-part form content as part of the call (it could even be a GET link that would redirect with a post payload).