search

HolmesProcessing / Holmes-Storage

The Storage Planner manages access to all data within the Holmes Processing system. It orchestrates the interaction across multiple Databases, serves the files for analysis, etc.
16 stars 7 forks source link

MongoDB object storage #17

Open ms-xy opened 8 years ago

ms-xy commented 8 years ago

MongoDB can store files, we should have the option to use it as object storage. Our configuration isn't flexible enough to support this right now, but we could default to MongoDB as object storage if MongoDB is configured as the storage but no object storage is specified.

webstergd commented 8 years ago

Will need to link to issue #15

cynexit commented 8 years ago

@ms-xy I don't see a flexibility issue here, it's as easy as adding a objStorerMongoDB. That being said, mongo has a lot of pitfalls like the 16mb limit we need to work around which is the reason it's not currently supported as a object storage. However, this is noted for the future.

webstergd commented 8 years ago

We would need to use Mongo's gridfs for storage. Shouldn't be terrible to add.