stratumn / go-core

Stratumn's core utilities to create decentralized applications and networks
Apache License 2.0
0 stars 0 forks source link

Refactor batch fossilizer storage #494

Closed t-bast closed 5 years ago

t-bast commented 5 years ago

The batch fossilizer currently stores fossils locally (using files) before periodically sending a bitcoin transaction. This doesn't work well in a micro-services architecture because a deployment or auto-scaling can screw up the files and make us lose pending-fossilization data (or worse fossilized evidence that hasn't reached the store). We need to decouple the batch fossilizer from its storage mechanism. This way we can use an implementation that leverages AWS SQS to make sure we never lose data.