Sync performance very poor

[amainz]

Performance is pretty poor to sync blocks since the last app versions. I cannot keep up with updating the blocks. I always start with a snapshot. I started with a gap of 2500 blocks to current block. After 2 hours running I got only progress of 400 blocks closer to current block since more blocks are created every minute.

What are your environment parameters?

• DeFiCh/app Version: 2.7.3
• Operating System (OS): Win10 – RAM (GB): 16 GB (used 7 GB) – CPU (Intel Core i5/i7/etc.): i5 (load 40%)
• Current free storage capacity: 50 GB (SSD)

Anything else we need to know?

defilogs.zip

[defichain-bot]

@amainz: Thanks for opening an issue, it is currently awaiting triage.

The triage/accepted label can be added by foundation members by writing /triage accepted in a comment.

In the meantime, you can:

1. Checkout DeFiChain’s Github issue page to see if your issue has already been reported
2. Submit any logs if you have them, this will greatly expedite the process for us.
3. You can also join our Telegram or Reddit community channels.

Details

I am a bot created to help the [DeFiCh](https://github.com/DeFiCh) developers manage community feedback and contributions. You can check out my [manifest file](https://github.com/DeFiCh/app/blob/master/.github/governance.yml) to understand my behavior and what I can do. If you want to use this for your project, you can check out the [DeFiCh/oss-governance-bot](https://github.com/DeFiCh/oss-governance-bot) repository.

[izzycsy]

Hi @amainz , you can use snapshot for faster synchronization. Alternatively, switch to DeFiChain Light Wallet on your mobile phone to save the hassle of running a full node wallet.

[amainz]

I always start with a snapshot, but even this small amount of missing blocks cannot be handled in a short timeframe. This remaining syncing is really slow.

[izzycsy]

Hi @amainz , running less applications on your PC when the app is syncing the last few blocks would help, also good internet connection.

[Esmiraldana]

I have exactly the same issue. But I have a gaming PC with 8 Core and 500mb internet. What is going on since 2.73 this wallet ia unusable. Is there any link to download an older version maybe that is faster?

[amainz]

@izzycsy I posted above the system utilization of my PC. As well the DSL bandwidth is not used at all. This is not a problem. The block syncing rate is extremely low since the last releases. Before it was also not good, but now you cannot sync properly at all. Can you please investigate?

[Esmiraldana]

Is there any older version after the last hardfork that is working faster? sb can provide download links?

[izzycsy]

Hi @amainz @Esmiraldana , thanks for your feedback, for your safety and security I do not recommend installing older version / deleting any files you're unfamiliar with, do keep your wallet.dat safe. Our team is constantly working on improving the app and solving its issues. Please give us time to investigate. Thank you for your understanding.

[izzycsy]

Hi @amainz @Esmiraldana , update v2.8.0 is out, this is a mandatory update. Kindly backup wallet before updating. 
Please read through the release notes before updating. This comment is to notify you about the update.

[izzycsy]

Hi @amainz @Esmiraldana , update v2.8.1 is out, this is a recommended update. Kindly backup wallet before updating. 
Please read through the release notes before updating. This comment is to notify you about the update.

[amainz]

@izzycsy I do not see any improvements in the last 2 versions regarding the performance. Still poor.

[Esmiraldana]

same for me!

[izzycsy]

Hi @amainz @Esmiraldana , did you reindex wallet?

[amainz]

@izzycsy I am using all the time the snapshot since the sync performance is very poor.

As per your request I restarted the syncing via "reindex wallet". Attached the results after 6 hours (not even reached 50% of all blocks).

You can see sync rate is less that 200 blocks per minute. Out of experience the sync rate is much lower when you are in the 90% range (snapshot start). My PC is stable with all resources nothing at limit at all.

[izzycsy]

Hi @amainz , can you try the latest update: v2.8.3 Kindly backup your wallet.dat and read through the change log before updating

[amainz]

Hi @izzycsy Thank you for the update. I did an update to v2.8.3 and started with the snapshot. Sync rate is at 10 blocks/min, so still a poor performance. Please keep me posted on progress of this issue.

[izzycsy]

Hi @amainz , can you try the latest update: v2.8.4

Kindly backup your wallet.dat and read through the change log before updating. This is a recommended update.

[amainz]

Hi @izzycsy Not better after update. Sync rate is at 12 blocks/min only.

[izzycsy]

Hi @amainz , if it's at 12 blocks /minute ; that's actually quite fast. You can check for the latest block height at https://defiscan.live/blocks .

[amainz]

Hi @izzycsy, Considering the gap from the last update and its snapshot I would need now 17 hours to sync to current status plus the blocks done at this time too. This is really slow. As you can see on the excel table above the sync rate per minute was 12x more at lower block levels.

[amainz]

Hi @izzycsy , I just used the "Defi Portfolio" and updated the blockchain via this app. The sync rate is at 240 blocks/min with "Defi Portfolio". After the update of the blockchain I opened "Defi Wallet" app and everything is updated. It seems that the "Defi Wallet" App has this low sync issue.

[izzycsy]

Hi @amainz , thanks for the update, our team will continue to look into the issue.

[izzycsy]

Hi @amainz @Esmiraldana , update v2.9.1 is out, this is a mandatory update. Kindly backup wallet and read through the release notes before updating. Kindly give a thumbs up if your issue has been resolved.

[amainz]

@izzycsy Hi, I tried this version when it came out directly. No improvement in performance.

[kjb92]

Hey everyone. I'm bumping this thread — I'm experiencing similar or even worse performance issues with my DefiChain Wallet App for Mac — I'm running the latest version 2.9.3. Now, what I'm trying to do is desperately recovering my funds with a backup .dat file I created a while ago. I've tried to re-install, reindex the wallet app on 3 different computers now (2 MacBooks + 1 desktop computer running windows to see if that does something about it) and still I haven't been able to successfully access my funds for weeks now! It is soo frustrating!

So what is happening in my case is that I'm able to install the wallet app, pull a snapshot, start at 99.X% and the node synchronizes successfully for the first time, BUT then once I import my .dat file and wallet does not fully synch anymore; it gets as up to 15 blocks away from a full sync, then stops for quite a while until about 200 blocks later, synchs another few blocks until close before full synch again, and the same endless loop starts all over again. What is going on?! Why is that happening?

Add: I just "ejected" my backup file again and created a whole new wallet, and the synch status is keeping up just fine! Green checkmark 24/7. But once I insert my backup file, the above described happens ... Can anyone make sense out of that behaviour and help me and others solve this for good?

[izzycsy]

Hi @kjb92 , the latest version is v2.10.0. Do you have other wallet.dat files? If you did not specify where you saved your wallet.dat on your Mac, it will be located here:

For Mac — Go to Folder: /Users/<username>/Library/Application Support/Defi/

In the wallets folder you'll likely see wallet-bak-123456789 as well, these are additional backups. Full guide on how to Restore Wallet from Backup.

[nippur72]

I have this issue since long time, six months or more. I have a fast Windows machine and fast connection. If I open Window's task manager, I see that the "defid" process has a very high CPU load (which is unusual).

I updated to v2.11.0 but nothing changed.

[izzycsy]

Hi @nippur72 @amainz @Esmiraldana , update v2.11.0 is out, this is a mandatory update. Kindly backup wallet and read through the release notes before updating.

After updating and synchronizing to 100%, if you face the same issue, kindly send your app log & node log.

[nippur72]

Attached are my v2.11.0 logs as it's still slow to synch: app_and_node_logs.zip

Below a screenshot of task manager where you can see defid is eating CPU time:

[amainz]

@izzycsy The sync performance is 0 blocks/hour. I see a lot of network errors in the logs. So, it is even worse with this version. Attached the logs. Defi_logs.zip

Thank you for your help.

[izzycsy]

Hi @nippur72 @amainz @Esmiraldana , update v2.12.0 is out.

1. Please backup wallet
2. Update to v2.12.0
3. Select Reindex Wallet & sync with snapshot

[amainz]

@izzycsy Same as before: syncing in not working. 0 blocks synced after 35 minutes. Logs attached Defi_logs.zip

Is your team actually working on this bug? I see only the request each time a new version comes out to re-check, but nothing is in the change logs about this bug. No offense.

Thank you for your support.

[kjb92]

Hey everyone, I was one of the people who had this issue now for several months too and just yesterday I was able to fix it! My wallet is now running super smooth. I'm not sure if it will work for you as well, but I'll just share what I did and maybe you are lucky too:

So, I'm running the wallet on macOS. I did the latest update to v.2.12.0 as @izzycsy told us to — BUT this time, what I did BEFORE installing the new app version was manually deleting all the data the app has created so far on my computer. On a mac you will find all this app data in the "application support" folder (finder-> go to folder). There, the app installs 2 folders named "defi" and "defi-wallet". I deleted both of them. CAUTION: make sure you saved a copy of your wallet-backup file(s) (.dat) before doing that. I chose the very first backup file I ever created for my wallet, saved it somewhere else and then went on with deleting those two folders. I thought: "hey, let's just reset everything" (— I tried the reindex wallet action in the app before and it didn't work for me, spent hours and days trying to synch it, so this time I thought: let's do it the hard way!) — and that actually worked! After deleting the 2 folders, I installed the latest app version, pulled the latest snapshot, waited for the synch to be completed and then imported my wallet-backup file. After just a few minutes all my assets were there and the node was synched completely! And the wallet usability since then is just outstanding now: sending funds out, adding liquidity, etc. — I'm getting a whole new experience with this app now! :D

Now, I'm definitely no expert on this, but I seems like there was something messed up somewhere in all the "data clutter" maybe preventing my wallet to synch properly (?!) and manually deleting all of that and re-installing the app and re-creating the necessary app data from scratch somehow solved it for me. (however, re-indexing or synching the node from scratch before did not do the job). I hope you are as lucky as I am! Let me / the others know if it worked for you as well or not.

@izzycsy hope this helps you and your team as well?

[izzycsy]

Hi @kjb92 , good to hear! Yes, what you did was reinstall DeFiChain app. But as you mentioned it's key to backup your wallets folder as without it you wouldn't be able to restore wallet. We are not responsible for your wallets, so please remember to backup often! Please ensure that you backup a working wallet.dat. Thank you for the follow up @kjb92 .

The first half of this guide will show you how to backup wallet

Hi @amainz yes, we try to make sure you're on the latest version and see if you're still facing the same issue, in extreme cases, we would suggest what @kjb92 did. In case user makes a mistake and forgets to backup. You can try what @kjb92 did. Please follow the steps thoroughly.

cc: @nippur72 @Esmiraldana

[amainz]

Hi @izzycsy , I deleted the whole installation on my windows computer and re-installed the defi-app and started with the snapshot. Surprisingly, the sync for the remaining blocks was done in 10 minutes and the sync was completed. Now, I had the option to install my backup wallet. After that step the syncing of blocks stopped. After 1 hour, no additional block has been synced. So, the syncing issue occurs only after I installed my backup walltet. Hope this helps for the triage.

Here the logs: Defi_logs.zip

Thank you for your help.

[izzycsy]

Hi @amainz , update v2.13.0 is out, this is a mandatory update. Kindly backup wallet and read through the release notes before updating.

You may refer to the 2nd part of this guide to Restore Wallet from Backup.

^ Inside your wallets folder should contain other wallet.dat backups, try restoring from those additional backups. You can find them via this file route: Windows — C: 
\Users\<username>\AppData\Roaming\DeFi Blockchain\wallets

[amainz]

Hi @izzycsy Finally I was able to sync completely after downloading the snapshot. Sync rate is at 20 blocks/minute. Not fast, but I could reach the last block, which did not work the past releases.

So, further improvements on the performance would be great.

Thank you.

[izzycsy]

Hi @amainz , thanks for the update, sync rate getting slow is expected as the difficulty per block increases; it's part of running a full node wallet. I would suggest moving to Light Wallet, you can download it from App Store / Play Store.

An FYI, The DeFiChain Light Wallet app's & Desktop app's restoration methods are irrelevant; meaning to say you can't load the 24 words from mobile app on to the desktop app and neither can you load the wallet.dat from the desktop to mobile. If you would like to use the mobile app (saving the hassle of running a full node wallet), you'll have to create a new wallet and transfer your funds to the mobile app. The team is currently working on integrating the mobile & desktop app — so you can use the same 24 words account concurrently. As for now, these are 2 independent applications.

I'll be closing this issue in the mean time. You may reopen this issue if there's new information (include screenshots) and your app logs. Thank you.