strands-project / mongodb_store

MongoDB tools for storing and analysing runs of ROS systems.
BSD 3-Clause "New" or "Revised" License
49 stars 72 forks source link

Large messages not supported #121

Open RaresAmbrus opened 9 years ago

RaresAmbrus commented 9 years ago

I've noticed the following error while trying to insert large point clouds in the database:

[ERROR] [WallTime: 1418751775.204544] Error processing request: BSON document too large (136251207 bytes) - the connected server supports BSON document sizes up to 16777216 bytes.
None

It would be nice if the database could support larger messages, as that would allow logging complete metric maps, and not just intermediate point clouds.

marc-hanheide commented 9 years ago

http://stackoverflow.com/questions/4667597/understanding-mongodb-bson-document-size-limit

RaresAmbrus commented 9 years ago

@marc-hanheide I am trying to figure out if/how I can use mongodb to store all the metric maps data. This limitation is annoying, because I would have to generate the complete sweep point cloud from intermediate ones whenever I want to run a test, which would be quite an overheard. Also, at the moment and XYZRGB point cloud takes about 4.6 MB; I would imagine a point cloud for the new Kinect would be close to the database file size limit of 16 MB.