search

mbari-org / vars-annotation

Video Annotation Application for MBARI's Media Management (M3) software stack
https://docs.mbari.org/vars-annotation/
Apache License 2.0
16 stars 6 forks source link

Request paging needs to robustified #115

Closed hohonuuli closed 5 years ago

hohonuuli commented 5 years ago

Currently we have sequential (one at a time) and parallel (all pages in one big blast) paging implementations. Sequential does not really take advantage of our infrastructure, parallel pounds the services resulting in timeouts. I need a new paging implementation that allows the following:

  1. Specifies the number of parallel requests allowed. (e.g. 2 or 3 should be sufficient)
  2. If a page request fails or times-out, will retry the request up to the specified retry count.
hohonuuli commented 5 years ago

I've improved the performance of annotation requests in annosaurus. Coupled with a robustifed pager, this is resolved.