search

steemit / steem

The blockchain for Smart Media Tokens (SMTs) and decentralized applications.
https://steem.com
Other
1.95k stars 791 forks source link

AWS EFS Support #2794

Open pauliusuza opened 6 years ago

pauliusuza commented 6 years ago

Would it be possible to support Amazon Elastic File System https://aws.amazon.com/efs for dockerized version in addition to S3?

pauliusuza commented 6 years ago

@jredbeard is that maybe something you could answer?

jredbeard commented 6 years ago

@pauliusuza It depends on what you are asking.

We currently use S3 to store shared memory files (basically state) for easy/fast launch from a regularly updated file. If you are asking if you could use EFS in this way instead of S3, the answer is yes. The dockerfile/scripts would need to be modified a tiny bit.

If you are asking if you could use EFS as a live filesystem to use as your datadir to run steemd with, that probably depends on what type of node. A 'full node' with all of the plugins probably can't (yet) do that, but might be able to keep up just fine once further plugins are migrated to rocksdb. A node that does account history or is a seed node might work just fine today using EFS as it's filesystem for datadir/shared memory. I haven't tested this personally, so I don't know for sure.

pauliusuza commented 6 years ago

@jredbeard thanks for reply.

The main use case for us would be to see if it's possible to use EFS as a single shared file system and to run multiple steemd nodes on top of that.

edit: but even using this as a replacement for S3 is very interesting too