search

dathere / datapusher-plus

A standalone web service that pushes data into the CKAN Datastore fast & reliably. It pushes real good!
GNU Affero General Public License v3.0
27 stars 21 forks source link

Smart preview selection (e.g. preview first n rows; latest rows; sample) #47

Closed jqnatividad closed 1 year ago

jqnatividad commented 1 year ago
jqnatividad commented 1 year ago

This is currently WIP and being implemented with the qsv download command. https://github.com/jqnatividad/qsv/issues/654

jqnatividad commented 1 year ago

preview last n rows implemented in https://github.com/dathere/datapusher-plus/commit/c5ada806775fc4806a1546521b80051e798e2956

If PREVIEW_ROWS is negative, create preview slice from the end of the file

jqnatividad commented 1 year ago

negative PREVIEW_ROWS has been implemented in 0.8.0.

Closing this now and will create a dedicated issue for preview sampling.