search

strands-project / mongodb_store

MongoDB tools for storing and analysing runs of ROS systems.
BSD 3-Clause "New" or "Revised" License
49 stars 73 forks source link

Integrate image and point cloud into the datacentre #8

Open hawesie opened 10 years ago

hawesie commented 10 years ago

Whilst mongodb_log has special loggers for these data types, we need to implement both the proposed ring buffer based logging for triggered recording, plus look into integrating existing work on compression for sequences of images and pointclounds (by @nilsbore) into the datacentre. It may be best for these types not to go into mongodb, but be stored separately somehow. Or perhaps identifiers for frames could go into the db but then be used to index into some compressed form.

marc-hanheide commented 10 years ago

mongodb has native support for this type of ringbuffer called capped collections. Would that fulfill our requirements?

hawesie commented 10 years ago

At the integration meeting we were also asked to provide the same infrastructure for logging larger amounts of data, e.g. from all topics for an entire run for experimental purposes. I will investigate capped collections, but we also should also look into compression for larger collections.