streaming and storing of the data from blockchain

[bobinson]

Blockchain ----> In-Memory-Cache

• design an algorithm to stream blockchain from the last irreversible block
• the captured data must be stored in Redis
• I/O failures must be handled
• This must be package that we can later call from a daemon or cli
• packaging must be done to enable pypy publishing in the future
• Pipfile based dependency handling
• multithreading / multi processing MUST be used only if needed or should be adequately justified
• Python 3.6.4 and Ubuntu 16.0.4 MUST be supported
• usage of file system based files or locks should be done carefully as we will need passive logic which will scale horizondally
• Transactions desgin patterns with init - run - commit should be used.

[bobinson]

In T61#1047, @bobinson wrote:

@sndp487   - please confirm

a) list of plugins enabled in PLAY

database_api login_api account_by_key_api network_broadcast_api tag_api follow_api market_history_api raw_block_api condenser_api

b) all the plugins available STEEM fulll node

account_by_key blockchain_statistics delayed_node raw_block account_history block_info follow tags account_statistics market_history witness auth_util debug_node private_message

c) tested environment is against PLAY or not

Due to this, tests aren't done yet.

The error was:

adapter = SteemV2Adapter(endpoints=['http://18.221.158.251:8090'])

rpcerror: '10 assert_exception: Assert Exception
itr != _by_name.end(): no method with name 'jsonrpc.get_methods'

can't enable plugin jsonrpc

reported by : @sndp487

@sndp487 - jsonrpc.get_methods is added in STEEM version 19.0.4 and hence you are getting this error. Fix the error by handling the same in your code. note - we are using STEEM 19.0.2

[bobinson]