search

Chia-Network / chia-blockchain

Chia blockchain python implementation (full node, farmer, harvester, timelord, and wallet)
Apache License 2.0
10.82k stars 2.03k forks source link

Extremely slow plotting on powerfull computer #4772

Closed Deutscher7 closed 3 years ago

Deutscher7 commented 3 years ago

I have a computer that is doing the plots extremely slow. I have an identical computer creating the plots in 5-6 hours. Same system, same configuration, same specs in both computers. Has anyone experienced the same issue? All temperatures are good. I'm lost

twitchplaystrading commented 3 years ago

Wie viel hast du den RAM-Speicher und Threads zugeordnet? Der beste Konfiguration ist +4GB RAM und 4 Threads habe ich gehoert.

JessePinkmanVN commented 3 years ago

5-7 hours is normal, I took 6 hours to complete a plot (of course in parallel), 32 gb ram, amd ryzen 9 5900 24 threads and nvme samsung 2tb

TorMazila commented 3 years ago

check out your disk i/o stats in windows task manager or similar tools in other OS's. It's likely the SSD is oversaturated with i/o during a plot.

Deutscher7 commented 3 years ago

I have a amd 5900 (12 cores)with 64gb ram and 2X 2TB nvme. I honestly don't understand what is wrong. 6 hours and 45 min and I'm still on 2:1 phase I m using Starting plot job: chia plots create -k 32 -r 10 -u 128 -b 5000 -t /mnt/ssd1 -d /mnt/hdd4. Thanks for the help Screenshot from 2021-05-13 10-07-04

Deutscher7 commented 3 years ago

check out your disk i/o stats in windows task manager or similar tools in other OS's. It's likely the SSD is oversaturated with i/o during a plot.

I do see that the io are really low in comparison with the other computer. in 6 hours and 45 min phase 2:1 it says 0:23 io. I'm using linux. The other pc has much higher numbers in 6 hours like 1:16 in the io. How can I improve that?

Deutscher7 commented 3 years ago

5-7 hours is normal, I took 6 hours to complete a plot (of course in parallel), 32 gb ram, amd ryzen 9 5900 24 threads and nvme samsung 2tb

you have my same cpu and I have 64gb ram and still I complete a plot in 11 hours. Do you use windows or Linux?

TorMazila commented 3 years ago

I do suggest running something that shows how loaded with i/o is your SSD. Maybe it's overheating or just "something is wrong". iostat and looking at iowait may give some clues. In FreeBSD there's gstat - but it's "geom"-specific tool. There are iotop, dstat, atop - try them.

Try trimming your SSD before launching plotting.

danarbraz commented 3 years ago

Firstly, "r 10" is pretty useless at the moment (and on your system, not wise for parallel jobs). Only the first phase is multithreaded. Try backing that down to 4 or 2 (I don't see a ton of diff between 2 and 4). Secondly, as others are saying, inspect your io. From your screenshot, your jobs are io-bound. Your last job alone has been waiting 23 mins on io and it's only in phase 2. I generally start with a low-ish number of parallel jobs where I see zero iowait through all phases. From there, I increase parallel jobs up to the point where I start to see some iowait (sub 10 secs) and leave it there.

jimmywong123 commented 3 years ago

it's about discard, you shuld add discard mode to your disk.

github-actions[bot] commented 3 years ago

This issue has been flagged as stale as there has been no activity on it in 14 days. If this issue is still affecting you and in need of review, please update it to keep it open.

github-actions[bot] commented 3 years ago

This issue was automatically closed because it has been flagged as stale and subsequently passed 7 days with no further activity.