search

NOAA-GSL / MATS

MATS is a quick & interactive way to view verification statistics
https://gsl.noaa.gov/mats/
6 stars 0 forks source link

Need to implement automatic downsampling fro datasets #278

Closed mollybsmith-noaa closed 3 years ago

mollybsmith-noaa commented 3 years ago

Author Name: randy.pierce (@randytpierce) Original Redmine Issue: 41388, https://vlab.ncep.noaa.gov/redmine/issues/41388 Original Date: 2017-11-28 Original Assignee: randy.pierce

It is possible to request so much data that the client chokes. It isn't rational to return more data than the client can display so we can implement downsample-lttb (Largest Triangle Three Buckets downsample algorithm by Sveinn Steinarsson) on the server side, watermark any plots that are auto-downsampled, and do all this on the server side to offload the clients. see... https://github.com/pingec/downsample-lttb

mollybsmith-noaa commented 3 years ago

Original Redmine Comment Author Name: molly.b.smith (@mollybsmith-noaa) Original Date: 2018-10-04T23:17:24Z

MATS now downsamples any dataset over 1 Mb. We used the lttb algorithm, which preserves outliers. The full dataset is available in the text output.