ethereum / mist

[DEPRECATED] Mist. Browse and use Ðapps on the Ethereum network.
http://ethereum.org
GNU General Public License v3.0
7.44k stars 2.12k forks source link

Ethereum node needs to sync, taking too long #2508

Closed statsdroneadmin closed 7 years ago

statsdroneadmin commented 7 years ago

It's taking far too long for ethereum node to sync. I've been running my computer for at least half a day, internet speed is definitely not the issue. I'm at block 2,000,000 of 3,866,000 and the last 150,000 blocks have probably taken at least 6 hours. I've tried to find other users commenting on similar issues and the only thing I could find was reference to the system clock of the computer. I'm on a mac so I've manually edited it but it doesn't seem to do anything so it's automatically synced with time.apple.com.

System information

Version: `0.8.10`
OS & Version: osx
Node type: `eth/geth 1.6.5 (go)`
turboyerbo commented 6 years ago

Sync Ethereum Mist quickly using Geth seemed to work! https://www.youtube.com/watch?v=01GFwytVFC4

It seems to take a fraction the amount of time if you follow the instructions and type

--fast --cache=512

after dragging the geth.exe into the cmd prompt...but it's still only sync about 75% of the blockchain....Fingers crossed!

tomtom87 commented 6 years ago

yes you must do this way. But if not ssd hard disk sync will never reach 100% it will always be a few blocks behind.

On 16 Nov 2017, at 02:22, turboyerbo notifications@github.com wrote:

Sync Ethereum Mist quickly using Geth seemed to work! https://www.youtube.com/watch?v=01GFwytVFC4

It seems to take a fraction the amount of time if you follow the instructions and type

--fast --cache=512

after dragging the geth.exe into the cmd prompt...but it's still only sync about 75% of the blockchain....Fingers crossed!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

Matthmatth88 commented 6 years ago

Downloading block 4,703,207 of 4,703,298 I hope I did not do it for nothing, I want the development software to integrate, J'ai appris à utiliser la console json et le pragma solidity cool la console je vois qu'elle est synchro avec le geth, je pense notre blockchain qui calcule les transactions

tyramisoux commented 6 years ago

@squivo - WOW after waiting two weeks now for sync, the --node-cache=2048 --node-maxpeers=50 as well as move the stuff to SSD did the trick after another 30 minutes. I was about to desperately drop the shit.

squivo commented 6 years ago

SSDs are what did the trick. So much i/o. Many write

tyramisoux commented 6 years ago

I hope the cache also does what it is supposed to (caching the write events) since I hope it won't ruin my SSD lifetime. In fact this is why I moved the stuff to HD before. Might be a good idea to backup more frequently anyway :-)

Matthmatth88 commented 6 years ago

eth.getTransaction(eth.getBlock(686927).transactions[0]) voila moi je veux insérer une transaction dans mon ethereum Wallet grâce à cette commande

2017-12-11 20:10 GMT+01:00 tyramisoux notifications@github.com:

I hope the cache also does what it is supposed to since I hope it won't it ruins my SSD lifetime. In fact this is why I move the stuff to HD

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ethereum/mist/issues/2508#issuecomment-350825919, or mute the thread https://github.com/notifications/unsubscribe-auth/Agz0Zb2FgVGbyBnVghfIkJiWk-mol_-vks5s_X5AgaJpZM4N4lv7 .

Matthmatth88 commented 6 years ago

Il suffit de suivre ça transaction grâce au block qui sont synchronisés mais après la télécharger je ne sais pas

2017-12-11 21:40 GMT+01:00 Matthieu Toussaint matth.toussaint88@gmail.com:

eth.getTransaction(eth.getBlock(686927).transactions[0]) voila moi je veux insérer une transaction dans mon ethereum Wallet grâce à cette commande

2017-12-11 20:10 GMT+01:00 tyramisoux notifications@github.com:

I hope the cache also does what it is supposed to since I hope it won't it ruins my SSD lifetime. In fact this is why I move the stuff to HD

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ethereum/mist/issues/2508#issuecomment-350825919, or mute the thread https://github.com/notifications/unsubscribe-auth/Agz0Zb2FgVGbyBnVghfIkJiWk-mol_-vks5s_X5AgaJpZM4N4lv7 .

ethy23 commented 6 years ago

After 1 full week of syncing still not getting there... delete the complete caindate etc but nothing. Seems it plays with me here. Short before 'almost finishing' it get stuck or recalcs and start (nearly) all over again. What a shit-app. F.E. Bcoin app takes about 6-7 hrs to sync the 160Gb chaindate. Totally f#cked up here

hawaii18k commented 6 years ago

Defrag the hard drive. I noticed i/o slowed down hard drive over 200% after geth tried to sync. which never completed by the way. After defragging, it finished syncing in few hours. I am surprised as how shitty the mist wallet is given all the attention ethereum is getting. I guess its concept and inner working is revolutionary, however UI is horrible for normal people like me. It can't even display history by default. Fuck You ether for wasting my time. only using it for ico etc.

ethy23 commented 6 years ago

Tnx Hawaii18K.. Have SSD with mgmt on it so that goes automatically. What did the trick was geht with light opt on. synced in 3 hrs (about 70Gb).. shitty prg who does load al the chain (like BCoin does w/160Gb)... but Bcoin loads in 3 mns and ethwall needs f#cking 2 hrs to sync. Think i shapeshift it to lcoin. have a nice wcnd!

emiliano1 commented 6 years ago

All of this is assuming you have geth in place etc and usually -v 1.7.2 or above.

ok it is final guys! This is the solution:

  1. $ cd ~/Libary/Ethereum/geth/
  2. $ mv chaindata chaindata_backup
  3. $ mkdir chaindata
  4. $ geth --fast --cache=1024
  5. open ethereum wallet but DO NOT click on Launch Application.
  6. Wait and if it all works fine (after 100% sync) then, remove the chaindata_backup file by doing $ ~/Libary/Ethereum/geth/chaindata_backup
Duiesel commented 6 years ago

Guys, use Ethereum CLI client from https://github.com/ethereum/go-ethereum. I use geth --datadir "<Your dir with geth and keystore dir inside>" --syncmode "fast" --cache 2048 --maxpeers 50 It works for me! Before using backup Your geth/chaindata dir and make new empty geth/chaindata dir.

mcna72 commented 6 years ago

Clean up your hard disk space. That will solve the problem.

mcna72 commented 6 years ago

I turned the app permissions on in windows firewall, cleaned up about 100 G on the hard disk and then it started downloading the blocks. It looks like the wallet is looking for space before it starts downloading.

dfalzetti commented 6 years ago

the geth sync kept failing every 10 to 15 minutes so in windows i created a sync.cmd file with the following and that took care of it.

C: cd "C:\Users\Dan\AppData\Roaming\Ethereum Wallet\binaries\Geth\unpacked"

:loop

%@Try%

call "geth.exe" --fast --cache=512 --datadir="D:\Ethereum-Wallet-win32-0-9-3"

timeout 2

%@EndTry% :@Catch goto loop :@EndCatch

goto loop

gciriani commented 6 years ago

@dfalzetti could you please explain what your batch lines do, one by one please?

Matthmatth88 commented 6 years ago

Il permettent de contrôler les transactions avec l'Attach en ligne de commande Javascript.JSON, admin.function() ex: miner.start(true)

2018-01-19 16:50 GMT+01:00 gciriani notifications@github.com:

@dfalzetti https://github.com/dfalzetti could you please explain what your batch lines do, one by one please?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ethereum/mist/issues/2508#issuecomment-359004326, or mute the thread https://github.com/notifications/unsubscribe-auth/Agz0ZR-K8Zi_YcvXlNy78MBy6tgVaS-bks5tMLm3gaJpZM4N4lv7 .

yihaient commented 6 years ago

I have a Macbook Pro and my Ethereum wallet will not sync all the way. How do I fully synce the blocks and chain structures? Been downloading to 99% for the last two weeks. Please give me step by step instructions for a beginner. Thank you.

UncleSnake commented 6 years ago

@dfalzetti

Your batch file work perfect, thank you.

For other: you need to change some parts due to different configuration of each machine.

raky35 commented 6 years ago

I am afraid Facing above problem ... sad, not a smooth start ..

Matthmatth88 commented 6 years ago

J'ai quand même entendu parlé que pour faire du mining il faut du matériel spécial alors changé votre matériel renseignez vous sur celui à acheter

Le 3 févr. 2018 09:31, "raky35" notifications@github.com a écrit :

I am afraid Facing above problem ... sad, not a smooth start ..

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ethereum/mist/issues/2508#issuecomment-362790556, or mute the thread https://github.com/notifications/unsubscribe-auth/Agz0ZQc12g3gFeFbBEFVfiW5wukauFg3ks5tRBlKgaJpZM4N4lv7 .

Matthmatth88 commented 6 years ago

https://www.ethereumminer.eu/cat/ETHEREUM-MINERS/612/Ethereum-Mining-Rigs.html?gclid=Cj0KCQiA2NXTBRDoARIsAJRIvLxKqqc1y4D_JHhle9A5LIsYcXPuJoA1ndjVrYGsBPVGLZ1nLuzqsmYaAgrAEALw_wcB

Le 3 févr. 2018 10:29, "Matthieu Toussaint" matth.toussaint88@gmail.com a écrit :

J'ai quand même entendu parlé que pour faire du mining il faut du matériel spécial alors changé votre matériel renseignez vous sur celui à acheter

Le 3 févr. 2018 09:31, "raky35" notifications@github.com a écrit :

I am afraid Facing above problem ... sad, not a smooth start ..

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ethereum/mist/issues/2508#issuecomment-362790556, or mute the thread https://github.com/notifications/unsubscribe-auth/Agz0ZQc12g3gFeFbBEFVfiW5wukauFg3ks5tRBlKgaJpZM4N4lv7 .

tommy2049 commented 6 years ago

any progress on this issue?

yihaient commented 6 years ago

No progress at all I have been running my brand new Mac to sync and for days now and it always gets stuck at the end. Can you please provide me exact step by step process to get the app to sync fully please.

Sent from my IPhone

On Feb 3, 2018, at 1:39 PM, Tommy Luo notifications@github.com wrote:

any progress on this issue?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

tomtom87 commented 6 years ago

Ok so here's how to make it sync:

  1. Check you have a ssd harddisk and some free space (like 10gb or so)
  2. Start the ethereum wallet, in the settings select sync fast sync / light client
  3. Leave it to do its thing, average at the moment is around 72 hours when im syncing up my nodes on dedicated servers or macbooks
  4. If you urgently need your wallet use myetherwallet - never send anyone your private key, and use a vpn and check the url is correct and u have not been sent to a phising site when you use myetherwallet

Sometimes you have to restart the wallet syncing, it will take atleast a day or more full syncin to get whole blockchain. Its very large now, so use light client if possible.

Hope you got it working... let me know if you get more problems

On 4 Feb 2018, at 05:04, yihaient notifications@github.com wrote:

No progress at all I have been running my brand new Mac to sync and for days now and it always gets stuck at the end. Can you please provide me exact step by step process to get the app to sync fully please.

Sent from my IPhone

On Feb 3, 2018, at 1:39 PM, Tommy Luo notifications@github.com wrote:

any progress on this issue?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

Matthmatth88 commented 6 years ago

[image: Images intégrées 2]

2018-02-03 22:39 GMT+01:00 Tommy Luo notifications@github.com:

any progress on this issue?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ethereum/mist/issues/2508#issuecomment-362856487, or mute the thread https://github.com/notifications/unsubscribe-auth/Agz0ZXzixNbeOkU-9daIPIS0F6jPd7wPks5tRNH2gaJpZM4N4lv7 .

Matthmatth88 commented 6 years ago

[image: Images intégrées 1]

2018-02-08 10:19 GMT+01:00 Matthieu Toussaint matth.toussaint88@gmail.com:

[image: Images intégrées 2]

2018-02-03 22:39 GMT+01:00 Tommy Luo notifications@github.com:

any progress on this issue?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/ethereum/mist/issues/2508#issuecomment-362856487, or mute the thread https://github.com/notifications/unsubscribe-auth/Agz0ZXzixNbeOkU-9daIPIS0F6jPd7wPks5tRNH2gaJpZM4N4lv7 .

danielocdh commented 6 years ago

Have been at it for months (not 24/7, probably an average of 10-12 hours daily), I remember updating the client at least 3 times already during this period of time. I only need like 150k blocks now, they download at around 1 block per second, sometimes faster sometimes slower.

Duiesel commented 6 years ago

Hello everyone, using pc with at least 8GB RAM + 8GB swap with ssd 250 GB drive solve this problem for me. In the other side I tried to sync at win, linux and mac and had the same result: it syncing one block slower then the new one created.

orbatec commented 6 years ago

I have sent ETH to my Ethereum Mist wallet...however, my client won't finish the sync anymore it seems...65 blocks left and there is sort of stalls... I wanted to use that ETH to buy some altcoins, but of course I can't get to see a balance. Adding a sole proprietor contract isn't working either...

Can I use the keystore of the Ethereum Mist wallet to access this wallet via another platform? I am pretty new to all this cryptocoin stuff, but am fairly savvy with cryptography and security in general, so you can go technical on me :-)

emiliano1 commented 6 years ago

@orbatec just import your key on www.myetherwallet.com and you should be able to do everything from there.

tyramisoux commented 6 years ago

At least I prefer to keep my wallet and keys on my own system.... In fact I also have major trouble. About 10 other wallets run nice except Ethereum. Today I have not more than 2 peers. sucks... And yes, I've read everything about "ISP limit swarm connections". But I do not have that troubles with others and able to connect to hundreds of peers using Bittorrent for example. And yes - my system clock is fine (NTP from Firewall NTP server)

orbatec commented 6 years ago

The whole geth --fast --cache=2048 didn't do diddly... So I ended up installing Parity and importing my geth keystore from Ethereum Wallet. Low and behold, my ETH is finally showing up! And it took Parity only about 2h to find my block.... On the downside I left my computer on all night and now I have some serious wear on the fans as it has been huffing and puffing non-stop with processor usage up to 171% ... I am fairly new to blockchain and cryptocoins, but this is a huge problem imho. I would expect that once you are in sync it should not continue to consume all of your resources, but it does...I actually find it quite useless this way...

Using myetherwallet -I assume- has the benefit that you are not doing the synchronization yourself: it is done by the platform...And yes, I too like to keep my wallet private, but the way it is now, it really isn't usable...

tyramisoux commented 6 years ago

I had no luck at all syncing with the light-client. After switched off it works way better. also forwarded 30303 from firewall to desktop. Seeing 2 incoming connections which seem not change a lot

raky35 commented 6 years ago

it is working for me know .

tyramisoux commented 6 years ago

I have no other idea than there must be attacks to the network. Had not more than 1 up to 3 peers for WEEKS but gone up to about 20 peers a few day ago. It is still very slow but continued importing! With cache of 2048 it is no problem at all using HD OR SSD since I/O and disc-access is very low as well as network traffic. When monitoring this I found "Microsoft photos" periodically takes a multiple of geth resources and bursting my drives hot. Removed that stuff to free shitloads of resources.

karikalanCyberForza commented 6 years ago

hi, i am using ubuntu 16.04 xenial when i have been installing ethereum wallet it showing "ethereum node needs to sync please wait " which is taking more time and how to fix this help me

sidhesham009 commented 6 years ago

my wallet downloading and synchronizing get lots of time. there is any option for reduce the time for downloading blockchain?

this is my code

`public class xyz { private static WalletAppKit kit; private static NetworkParameters params = TestNet3Params.get(); private File file;

public xyz(File file) throws BlockStoreException {
    this.file = file;
}

public static void refresh() throws ExecutionException, InterruptedException {
}

public void initialdownload(String btcpri, Context context) {
    ECKey key;
    BigInteger privKey = Base58.decodeToBigInteger(btcpri);
    key = ECKey.fromPrivate(privKey);
    setSDKThread();
    BriefLogFormatter.init();

    kit = new WalletAppKit(params, file, "bitcoin_wallet") {
        @Override
        protected void onSetupCompleted() {
            wallet().importKey(key);
            wallet().allowSpendingUnconfirmedTransactions();
            setupWalletListeners(wallet());
        }
    };
    kit.setDownloadListener(new DownloadProgressTracker() {
        @Override
        protected void progress(double pct, int blocksSoFar, Date date) {
            super.progress(pct, blocksSoFar, date);
        }

        @Override
        protected void doneDownload() {
            super.doneDownload();
        }
    });
    kit.setBlockingStartup(false);
    kit.startAsync();
}

private void setSDKThread() {
    new Handler(Looper.getMainLooper()).post(new Runnable() {
        @Override
        public void run() {
            final Handler handler = new Handler();
            Threading.USER_THREAD = handler::post;
        }
    });
}

private void setupWalletListeners(Wallet wallet) {
    wallet.addCoinsReceivedEventListener((wallet1, tx, prevBalance, newBalance) -> {
        if (tx.getPurpose() == Transaction.Purpose.UNKNOWN);
    });
    wallet.addCoinsSentEventListener((wallet12, tx, prevBalance, newBalance) -> {
    });
}

}`