Will you consider HDFS as backend storage?

uber-archive / cherami-server

Distributed, scalable, durable, and highly available message queue system. This project is deprecated and not maintained.

https://eng.uber.com/cherami/

MIT License

1.42k stars 102 forks source link

Will you consider HDFS as backend storage? #320

Open luopeien opened 6 years ago

luopeien commented 6 years ago

As most part of the message storage is append only, so why not using HDFS as its backend? In that case, no need to do replication self, HDFS takes the work.

Moreover, by writing messages to HDFS allows possible MR work on storage directly.

Will performance be a problem?