Merge trawl survey haul lat, lon, date/time data with ctd data

nwfsc-fram / OceanTS

Oceanographic data processing in Typescript using NodeJS and Apache Arrow

0 stars 3 forks source link

Merge trawl survey haul lat, lon, date/time data with ctd data #6

Closed ghost closed 5 years ago

ghost commented 5 years ago

Axios data pull of haul characteristics data is now working, now I need to figure out how to convert the array of JSON objects over to an arrow table.

ghost commented 5 years ago

filtering of hauls arrow table mechanics are in place, however it is still returning the complete table, continuing to investigate.

ghost commented 5 years ago

filtering hauls arrow table for haul that spans the time of the cast is now working using an arrow custom predicate filter per the Filtering Timestamped Data section from https://observablehq.com/@theneuralbit/using-apache-arrow-js-with-large-datasets

ghost commented 5 years ago

finished this integration.