search

oysterprotocol / brokernode

Server that connects to the Tangle to enable the Oyster Protocol
36 stars 9 forks source link

Update Create/CreateBeta method #634

Open pzhao5 opened 5 years ago

pzhao5 commented 5 years ago

Saving the following data into S3 so that lambda could process it.

  1. Data format as gensis_hash/data/file_index. File contains a BatchSize of data.
  2. Genesis Hash as gensis_hash/hash/file_index.
  3. Each data and genesis hash is 1:1 mapping. And there is not treasure within.
  4. Config data(single file) so that lambda knows how to process it.
  5. Treasure map data (single file).

When lambda attach to the data, it would first download config data and treasure map. And then start to upload each data/genesis hash in pairs. When arrive to a particular index that need to skip (for inserting the treasure), Lambda will then insert it with treasure rather than the data.

rfornea commented 5 years ago

Went ahead and approved this but we should see if we can figure out what the deal is with Travis