gcmcnutt / Sensor2

CMSensorRecorder direct to DynamoDB experiments
Apache License 2.0
4 stars 1 forks source link

do some analysis on an alternate dequeue #16

Open gcmcnutt opened 7 years ago

gcmcnutt commented 7 years ago

right now, the system takes several seconds per 25 second batch. while we are still relying on the watch to do this work (conceptually this is so the watch can dequeue independent of the phone), AND we aren't yet relying on post-process in AWS -- e.g. direct to dynamo.

this does wind up putting a lot of work in the watch

gcmcnutt commented 7 years ago

the file-to-phone branch includes a batch-only mode where watch goes through file transfer to phone who does the heavy lifting -- this increases latency to data visibility, but does greatly reduce the work on the watch -- need to redo some of the old profiles to see how much improvement, etc.