np appending in antTracker

beelabhmc / ant_tracker

Track ant movement in a lab setting using ML

http://hmcbee.blogspot.com/

1 stars 1 forks source link

np appending in antTracker #9

Closed aryarm closed 5 years ago

aryarm commented 6 years ago

each time antTracker processes a single video, it stores the results in a growing np array at the end, it writes this entire array to disk all at once

it might be better if antTracker wrote its results immediately to disk each time it received them

this will free up memory
and make the script more robust to unexpected errors that might happen when it is processing any single video (since the other results won't be lost; they're already written disk)

JarredAllen commented 5 years ago

With converting to a pipeline, the video processing is separated to different function calls, so this issue has been resolved by commit 085775ef6a470b7bc4b694ca541eaf9013916780.