search

moiot / gravity

A Data Replication Center
Apache License 2.0
901 stars 173 forks source link

queue and store and backups #137

Open joeblew99 opened 5 years ago

joeblew99 commented 5 years ago

There is a golang library that is written by the golang team to allow your go code to use different Messages Queues and Stores. So for Gravity make it easier to use different queues and stores, which is exactly what its intend is.

Message Queues https://github.com/google/go-cloud/blob/master/pubsub/pubsub.go There is no Kafka one yet, but it has NATS

Blob Store ( like s3) https://github.com/google/go-cloud/tree/master/blob

Ryan-Git commented 5 years ago

it's aimed at cloud provider products, a higher level than "plain" systems like kafka, mysql, etc.. it would be better to add additional input/output for such products, leveraging this lib.

ghost commented 5 years ago

It has NATS which runs n premise or on cloud.

There is also an elastic search equivalent in that is written in golang called blast. Also can run on premise or on cloud. Also has Facets and supports all languages too. It an Apache project. https://github.com/mosuka/blast

The reason I use these and not Kafka // Elastic search is :

  1. Must less resource usage
  2. Much faster
  3. Easier to deploy and operate
ghost commented 5 years ago

Hey @Ryan-Git they just added Kafka also https://github.com/google/go-cloud/tree/master/pubsub