[Question]: Exporting transactions from raw DB files

multiversx / mx-chain-go

⚡ The official implementation of the MultiversX blockchain protocol, written in golang.

https://multiversx.com

GNU General Public License v3.0

928 stars 202 forks source link

[Question]: Exporting transactions from raw DB files #5566

Closed doudyy closed 1 year ago

doudyy commented 1 year ago

Question

I'm attempting to export all transactions related to a specific account without involving Elasticsearch, and I'm wondering if it would be possible for me to write a Go program (starting from the mx-chain-go code) to directly read the LevelDB database e.g. elrond-nodes/node-0/db/1/Epoch_1126/Shard_0/Transactions/000002.ldb.

Are there any technical issues blocking me from completing such a task?

Code of Conduct

[X] I agree to follow this project's Code of Conduct

bogdan-rosianu commented 1 year ago

Hello. Yes, you should be able to perform this. What to take into consideration:

the Transactions unit will only contain the user-triggered transactions (so will not include the SCRs, rewards txs and so on). For the rest, you should also parse UnsignedTransactions, RewardTransactions, and Receipts
You should range over the keys of that database. The key will be the transaction's hash, while the value will be the gogo protobuf serialization of the transaction. For go you can use this, for js/ts you can use this and for java you can use this

bogdan-rosianu commented 1 year ago

Hi @doudyy did you have the chance to take a look over my answer? Can we close this issue?

doudyy commented 1 year ago

Thank you for your valuable insights for parsing the LevelDB database. However, after a thorough examination, I've come across significant technical intricacies.

Unfortunately, due to the project's intricate nature and the challenges posed by the over-engineered design, coupled with limited resources for quality support from your technical team, I will aim to refrain from any further involvement with the MultiversX project.