search

straumat / blockchain2graph

Blockchain2graph extracts blockchain data (bitcoin) and insert them into a graph database (neo4j).
GNU General Public License v3.0
148 stars 32 forks source link

An Error ocurred while processing a Block: Origin Transaction not found #611

Open teachmlrepo opened 4 years ago

teachmlrepo commented 4 years ago

Hello,

I receive a message on dasbhboard like An Error ocurred while processing a Block: Origin Transaction not found, and the block number 107906 is currently being processed for a long time Is this Normal behaviour is there any issue, I have a 32GB, 8 Core 1TB machine

with regards

straumat commented 4 years ago

seems there was a big problem :( strange, it should not occur. I think you have to delete and restart. Really sorry. U r using the 3.0 release ?

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports:

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports:

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports:

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports:

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports:

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

====================================================================================================================

https://hub.docker.com/r/straumat/blockchain2graph-bitcoin-neo4j/

blockchain2graph-bitcoin-neo4j: image: straumat/blockchain2graph-bitcoin-neo4j:3.0 ports:

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

teachmlrepo commented 4 years ago

neo4j: image: neo4j:3.5.12 volumes:

teachmlrepo commented 4 years ago

I am using this docker-compose https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

teachmlrepo commented 4 years ago

I am using this docker-compose https://gist.github.com/straumat/54edc240554f84c71b81a8d926b8f5be#file-docker-compose-blockchain2graph-bitcoin-neo4j-yml

straumat commented 4 years ago

This should have never happend :( a transaction is missing but I use transaction so a block could not have a missing transaction :(

teachmlrepo commented 4 years ago

Ok How can I ensure bitcoin is converted to a graph can I bypass this issue / avoid this issue to get a complete graph on my server Thanks

teachmlrepo commented 4 years ago

Can you please let me know which version of bitcoin-core and bitcoin2graph should be used, I have tried 3.2.2 SNAPSHOT , with bitcoin-core 0.20.1 I get An error occurred while processing block : Error mapping GraphModel; nested exception is org.neo4j.ogm.exception.core.MappingException: Error mapping GraphModel

Hope this will not have any impact on building graph

straumat commented 4 years ago

You should use the 3.0.0 release. and it's tested in bitcoin 0.18.

teachmlrepo commented 4 years ago

Thank you

teachmlrepo commented 4 years ago

I have used 3.0 and 0.18.1 the GUI says 100 007 blocks in bitcore

May I know if additional blocks aare added and updated in real time what is the max blocks expected as of today. Will the bitcioin core node in real itme update neo4j database ?

i see this log , I am confused why block size is not increasing

2020-09-15T10:30:56Z Pre-allocating up to position 0xf00000 in rev02239.dat bitcoin-core_1 | 2020-09-15T10:30:56Z UpdateTip: new best=000000000000000000096888085829a5027e71a4e16a2fdb5bca9c98fd7c74f1 height=648399 version=0x20800000 log2_work=92.28727 tx=568464980 date='2020-09-15T10:30:39Z' progress=1.000000 cache=626.6MiB(4650302txo) warning='70 of last 100 blocks have unexpected version' blockchain2graph-bitcoin-neo4j_1 | 10:34:43 - =================================== blockchain2graph-bitcoin-neo4j_1 | 10:34:43 - No block to process, Retrying in 10 minutes blockchain2graph-bitcoin-neo4j_1 | 10:44:43 - =================================== blockchain2graph-bitcoin-neo4j_1 | 10:44:43 - No block to process, Retrying in 10 minutes bitcoin-core_1 | 2020-09-15T10:46:34Z UpdateTip: new best=0000000000000000000665a961b2f59a498a7b47399e8a0b6779c1b16d66c116 height=648400 version=0x20800000 log2_work=92.287287 tx=568467913 date='2020-09-15T10:46:03Z' progress=1.000000 cache=627.0MiB(4654075txo) warning='70 of last 100 blocks have unexpected version' blockchain2graph-bitcoin-neo4j_1 | 10:54:43 - =================================== blockchain2graph-bitcoin-neo4j_1 | 10:54:43 - No block to process, Retrying in 10 minutes bitcoin-core_1 | 2020-09-15T10:57:20Z UpdateTip: new best=0000000000000000000c9065749e5011b9c5ca709265c9a965aad40c67374a59 height=648401 version=0x3fffe000 log2_work=92.287305 tx=568470671 date='2020-09-15T10:57:21Z' progress=1.000000 cache=627.3MiB(4656706txo) warning='70 of last 100 blocks have unexpected version' bitcoin-core_1 | 2020-09-15T11:00:30Z UpdateTip: new best=000000000000000000048996fe5ca412f21385d3088d05f87339d5a615d98f35 height=648402 version=0x3fff0000 log2_work=92.287323 tx=568473385 date='2020-09-15T11:00:21Z' progress=1.000000 cache=627.5MiB(4658059txo) warning='70 of last 100 blocks have unexpected version' blockchain2graph-bitcoin-neo4j_1 | 11:04:43 - =================================== blockchain2graph-bitcoin-neo4j_1 | 11:04:43 - No block to process, Retrying in 10 minutes bitcoin-core_1 | 2020-09-15T11:05:21Z UpdateTip: new best=000000000000000000064a661fa944becf36444edda3b936d2f6f510fa731656 height=648403 version=0x20800000 log2_work=92.287341 tx=568475914 date='2020-09-15T11:04:59Z' progress=1.000000 cache=628.5MiB(4666499txo) warning='70 of last 100 blocks have unexpected version'

WHere can i find some information related to these Thanks

straumat commented 4 years ago

New blocks are added in real time. This message is strange : bitcoin-core_1 | 2020-09-15T11:05:21Z UpdateTip: new best=000000000000000000064a661fa944becf36444edda3b936d2f6f510fa731656 height=648403 version=0x20800000 log2_work=92.287341 tx=568475914 date='2020-09-15T11:04:59Z' progress=1.000000 cache=628.5MiB(4666499txo) warning='70 of last 100 blocks have unexpected version'

Can you check how many block you have in bitcoin core please ?