ruffinaj
commented
5 years ago Hey, Bobinson. Thanks for the request! I've tried emailing you a few times but several have bounced as I'm not quite sure on how to format your address. If you haven't received a message from me, would you please email me at andrew [dot] ruffin {at} intel.com?
bobinson
Name, email, company, job title
Bobinson, bobinson at-theRATE uinp.io , Ucen Blockchain Co(HK), Ltd, Chief Architect
Note that projects with two or more participants are preferred.
Project Title and brief description
At UINP.io we are working on a "Novel Cross (block)chain communication Protocol". We are using Bitcoin Core, Etherium and Graphene (Bitshares/EOS/STEEM) based chains for the project. As part of the project we work with STEEM blockchain which is one of the most active blockchain interms of daily transactions and may be based on the number of active users. ( reference: https://www.blocktivity.info/ ). The blockchain evolved from the Graphene blockchain engine which later laid the foundation for Bitshares and EOS. The STEEM blockchain has an innovative mechanism to snapshot and store certain aspects of its data from the single blockchain file which can be the bottle neck for performance due to the single threaded nature of the blockchain code. STEEM is using RocksDB For the storage and it plans to move much of the blockchain data which is traditionally stored in the single blockchain files to the RocksDB.
A little detailed description of the blockchains and how Optane can help in improving and innovating the blockchain spectrum is given here : https://steemit.com/steemdev/@bobinson/using-intel-optane-for-steem-blockchain-seed-node
How does the open source community benefit from your work?
All the components in the project are open source (MIT, BSD etc) & test results will help to advance the blockchain technology space as the STEEM code base is shared with other major blockchains such as Bitshares, EOS & SCORUM. There are also popular C++ libraries like boost.org used extensively and the test results may also bring about specific aspects of Optane technology and compatibility with various boost library functionalities in popular use cases like image processing.
And added advantage: Further, with the recent LMDB test results on the Optane, which mentions read bottle necks of RocksDB, this testing will give a two fold improvement to the community as we will be able to test not just the blockchain aspect but perhaps we will be able to observe the RocksDB performance over a period of time and share the results with he open source community.
Is the code that you’re going to run 100% open source? If so, what is the URL or URLs where it is located?
Yes.
The main repository is : https://github.com/steemit/steem/
For performance and bench-marking, there are dedicated tools like Tinman : https://github.com/steemit/tinman
The community is actively participating in the project by sending PRs, doing extensive testing of the releases etc.
Various community efforts to contribute to the core project and supporting libraries are shared below:
https://github.com/SteemCommunity/ - community contribution for testing of releases https://github.com/someguy123/steem-docker - Docker based deployments https://github.com/Jolly-Pirate/witness-failover - High availability utility for the network (This works 24x7 like an army of hamsters!) https://github.com/holgern/beem/ - Python Utility library https://github.com/gitschwifty/pywit - Python utilities to manage the blockchain network https://github.com/witness-essentials - NodeJS tools to handle the blockchain network
I must accept that I have kept the best of it to the last and it is https://join.utopian.io/ which ensures revenue streams to open source developers and the recent steemtank initiative.
Active participation from the community in testing releases:
https://steemit.com/witness-category/@lukestokes/witness-update-lukestokes-mhth-v0-20-6rc1-review
Does the infrastructure provided meet your testing needs (see: https://www.acceleratewithoptane.com/access/)?
In general we are using 512 GB RAM for the deployments and we are hoping to reduce the RAM deployment by using Optane. We would like to discuss with you on this aspect.
What performance-focused articles has your project published before?
The project's bottleneck is I/O which is both for the long term storage and for short term storage. My initial test results are published here : https://steemit.com/steemdev/@bobinson/using-intel-optane-for-steem-blockchain-seed-node
A followup with a little intensive and systematic testing will be published before next Tuesday.
Please state your contributions to the open source community and any other relevant initiatives
Feel free to brag a little bit about yourself! - Thank you!
This work is extensively covered in the media and I had the good fortune to be one of the lead volunteers and be in touch with experts from UN/UNESCO etc and work with a group of FOSS volunteers.
Would you be willing to share your analysis and results publicly?
Believes in Free Knowledge Sharing and learning and intend to publish the results.
Are you interested in testing Intel Optane SSDs with Intel Memory Drive Technology (IMDT)?
Yes