hsci-r / filter-visualizations

Visualizations of Finnic oral poetry collections.
Other
0 stars 1 forks source link

Simplify the `octavo` and `url` sources #30

Closed maciejjan closed 7 months ago

maciejjan commented 9 months ago

The values octavo and url for the source field of a visualization are used to retrieve data from Octavo and Runoregi, respectively. They include some hardcoded workarounds that can easily break if something changes in the upstream tools.

Instead, the sources should be specified as "remote CSV" (and perhaps "remote JSON"), with the URLs encoding visualization-specific information (e.g. fields and level in Octavo).

For JSON output, the jqr package can be used to define data transformation in a declarative way, using jq syntax (instead of R code in the field extractor, as it is now).