willie68 / GoBlobStore

A multi-tenant proxy service for storing binary data in various storage systems with a simple HTTP interface.
Apache License 2.0
0 stars 0 forks source link

Searching for blobs based on the given properties #12

Closed willie68 closed 2 years ago

willie68 commented 2 years ago

At the time of writing the blob store is a simple key/value store for big binary data. But if you lose the key, you have no way to search for the blob. At most, you can browse through all the blobs and check if this is the blob you need. It would be nice if I could also search for my supplied properties.

willie68 commented 2 years ago

Normally this can be done with a database. So you can simply throw all your properties and the blob id into a database and do the searching stuff by your own. For smaller installations, however, this brings with it additional complexity. Therefore, with this small service in small installations, it would be worth considering bringing your own small database with you. Since the market is huge, I had to make a pre-selection based on the following criteria.

willie68 commented 2 years ago

After thorough research and consideration, I came across Project Genji (https://genji.dev/). This forms a layer above Peeble (https://github.com/cockroachdb/pebble), which is implemented specifically for document-based searches. So the first POC like implementation will be done with Genji.

willie68 commented 2 years ago

Hmm, genji semms to be a little unstable at the moment. So i start with a database server implementation like mongodb or orientdb.

willie68 commented 2 years ago

implementing mongodb as query engine. adding own simple query language

willie68 commented 2 years ago

i close this item. For further implementations create seperate items