madMAx43v3r / chia-plotter

Apache License 2.0
2.27k stars 664 forks source link

Plot time increase from 45 to 56 mins #684

Open chiamb opened 3 years ago

chiamb commented 3 years ago

I am using Mad Max from begining. On the start time for creating plot was 45-46 mins on Ryzen 7 3700x and 32GB RAM, 2x1tb Nvme, but time is increased to 56 mins with same settings. I tried to change bucket and threads but results are similar in all versions of Mad Max

j-filippovs commented 3 years ago

Hi, so looks like i'm not alone who notice that. At the beginning I was able make 1 plot in 28-29 minutes. After 1 week 30-34 minutes and now 39-44 minutes. I got Ryzen 9 3900X, 32GB RAM, 2x1TB NVME. Even on 2nd PC time increase from 26 minutes up to 36 with Threadripper 2990WX and 132GB RAM + 2TB NVME and 1TB NVME

chiamb commented 3 years ago

Many people that I know have this time issue.

j-filippovs commented 3 years ago

I found previous complain where it says that it can be because of nvme drive usage. But even after trying my other nvme drives - time still are the same.

funnycubeguy commented 3 years ago

this is probably due to processor degradation. a new processor will reach higher boost clocks and sustain them longer. it is very hot in the summer which can also attribute.

chiamb commented 3 years ago

this is probably due to processor degradation. a new processor will reach higher boost clocks and sustain them longer. it is very hot in the summer which can also attribute.

I don't think that is about cpu degradation and it's properly cooled. What is fix? @madMAx43v3r

funnycubeguy commented 3 years ago

this is probably due to processor degradation. a new processor will reach higher boost clocks and sustain them longer. it is very hot in the summer which can also attribute.

I don't think that is about cpu degradation and it's properly cooled. What is fix? @madMAx43v3r

it is properly cooled to an extent. ryzen processors target 80C and regulate their own voltage. a combination of high temps + high voltage to reach their target boost for sure causes this. there are a couple videos testing old and new ryzen processors showing degradation with just gaming. we are plotting which pins the cpu at max boost 24/7. madmax code has not changed as you have also tested old versions.

chiamb commented 3 years ago

this is probably due to processor degradation. a new processor will reach higher boost clocks and sustain them longer. it is very hot in the summer which can also attribute.

I don't think that is about cpu degradation and it's properly cooled. What is fix? @madMAx43v3r

it is properly cooled to an extent. ryzen processors target 80C and regulate their own voltage. a combination of high temps + high voltage to reach their target boost for sure causes this. there are a couple videos testing old and new ryzen processors showing degradation with just gaming. we are plotting which pins the cpu at max boost 24/7. madmax code has not changed as you have also tested old versions.

My cpu never go up 65c maximum.

we-sell-bags commented 3 years ago

there is some issue........ i'm wondering if it was the removal of the MP libraries....

or... is it that the printed times have been wrong .. and now they are right....

madMAx43v3r commented 3 years ago

can you post the version numbers or commit hashes to compare what has been changed?

chiamb commented 3 years ago

I used version for windows v0.0.4, v0.0.5 and v0.0.6.

madMAx43v3r commented 3 years ago

and between which is the slow down?

sotasyl commented 3 years ago

Yes, I confirm that. Version I downloaded on Jun 11 is a bit faster than one from Jun 15, maybe 10%. So if there's no security fixes or compability issues I'd stick with an old one, even though it's without plot completion feature on Ctrl+C and creation time in minutes

madMAx43v3r commented 3 years ago

default buckets has been changed to 256 between those

chiamb commented 3 years ago

In all versions are slow down from 46 to 56 mins with 256 buckets

we-sell-bags commented 3 years ago

i have some idea that i was seeing ~30 min on a hp server.. but now i see 60 min..., but it may just be wishful thinking. I use it for stress testing the servers & datapaths to storage... no other reason...

hidoba commented 3 years ago

Ryzen 7 3700x running at 4GHz, 16GB RAM @3200-16, Ubuntu 20.04. 1 plot takes 38.5 min, and no sign of degradation from the very beginning. I'm using separate samsung 980 pro NVMe drives for tmp1 and tmp2, but it would be not much different if I used the same one (about 1 min longer if I remember correctly). For some reason my computer kept crashing when I did mdadm raid0, but the plot time was similar (no crashes after disabling raid0), so no point to raid0 on my hardware.

chiamb commented 3 years ago

Ryzen 7 3700x running at 4GHz, 16GB RAM @3200-16, Ubuntu 20.04. 1 plot takes 38.5 min, and no sign of degradation from the very beginning. I'm using separate samsung 980 pro NVMe drives for tmp1 and tmp2, but it would be not much different if I used the same one (about 1 min longer if I remember correctly). For some reason my computer kept crashing when I did mdadm raid0, but the plot time was similar (no crashes after disabling raid0), so no point to raid0 on my hardware.

So, the problem is not amd degradation.

j-filippovs commented 3 years ago

Hi, looks like i fix everything and issue i had was not with max chia plotter but exactly with my PC. Everything is fixed now and 1 plot can do now in 28-29 minutes. On 2nd PC i still got issue but looks like Threadripper 2990WX with 128GB is not the best choice. My 800gbp PC works much better compare to 2k PC. Anyway i'm not disappointed because every day learn something new which is worth that money :)

chiamb commented 3 years ago

Hi, looks like i fix everything and issue i had was not with max chia plotter but exactly with my PC. Everything is fixed now and 1 plot can do now in 28-29 minutes. On 2nd PC i still got issue but looks like Threadripper 2990WX with 128GB is not the best choice. My 800gbp PC works much better compare to 2k PC. Anyway i'm not disappointed because every day learn something new which is worth that money :)

What is fix?

j-filippovs commented 3 years ago

In my case i had issue with power and overheat. Now using PC with OC where my ram is working on 3600Mhz. Before always was going back to 2400Mhz.

AlenG1977 commented 3 years ago

Yup, the same problem here. I use v0.0.5 and i had times from 56-58 minutes for plot on R5 3600x w 32GB of ram on 3200MHz, 2 same m.2 ssds of 1 TB. From last night times went to 80 minutes. I set it to plot 36 plots last day, and around 2 am this morning, time went up after 14-15 finished plots. CPU is not going over 62C, m.2s are below 45C even in the middle of the day... what happened?

Thanks for the answer Alen

reb0rn21 commented 3 years ago

I have two same plotter 5900x + 4x raid HDD temp 1 and 110GB ram temp2 (ubuntu 21.04) plot time is 2380s on both, one machine after 50 plots just dropped time to ~2900s+ have no idea why, sure temp in phase1 go to 91C on both but mostly P2 and P3 slower on 2nd machine, tried to recreate raid 0 and restart machine and still same...

Also noticed that on slow plotter coping to same brand USB 3.0 drive dropped from 80mb/s to 59mb/s, as both use same HDD raid0 for temo1 and I checked smart data on drivers and they are fine and all is 100% same config I have no idea

RESOLVED: For my case it is temp related as soon I left room door open, plot speed is up 20% was it CPU or HDD temp (they where at 51C the ones at raid 0) I have no idea

AlenG1977 commented 3 years ago

I have tried the new version and i have same results :( I don't have issues with temperatures, m.2 drives are below 46C max, hdd that i plot on is at 41-42, room temperature is the same, i have tried different bucket set ups and i just can't get those times i had till the day before yesterday can you give any suggestion? @madMAx43v3r ? Times for plotting went up 50%

reb0rn21 commented 3 years ago

I guess its your own nvme slowing down or CPU overheat

AlenG1977 commented 3 years ago

That couldn't be the reason... i was plotting without heat sinks and temps were up to 63C and the times were better, in the mean time i lowered temps to 47C max (av at 39-43*C) and the times were the same, and then, out of the nowhere plotting has prolonged somehow... CPU temps are OK

reb0rn21 commented 3 years ago

I did not say it because of temp, NVME slow down for xy reasons, I say its 99% not mad max issue its you config, I bet on crappy nvme brands, trim etc

MTE-MMO commented 3 years ago

I also have the same issue.

35min for the first plot and after increase, increase and increase the time to reach more than 2h/plot. I start one after the other madmax process in "for" powershell loop script and copy in parrallel in final destination with another script.

With Swar-Chia-Plot-Manager I had not this issue. Always 28 to 32 plot a day with 18//.

Setup: MadMax : v0.0.6 Os : Windows 10 Pro Processor : intel i9-10850K TDP 125W with ventirad be quiet! Dark Rock Pro TDP 250W (Max temp 75°C) Mother board : Asus Z490-p Temp SSD : Corsair MP400 2 TB + dissipator and fan (max temp 46°C) RAM : HyperX FURY 4 x 16Gb 3200MHz CL6 Power supply : Gygabyte GP-P850GM

chandlerchao commented 3 years ago

I noticed an incremental increase in plot times when I was testing 128 threads. The first plot was about 70min and then increased about 10-15min per successive plot. I am now running 24 threads and don't see an increase in plot times like that at all. That was Windows v0.0.6.

reb0rn21 commented 3 years ago

After first plot at start of 2nd and 3th you need to copy past plot to destination! thats why speed go down! Also slow down is as you most use shite NVME which have issue with performance or you whole system is slowing down under load/temp

Nothing to do with madmax code!

rsokolowski commented 3 years ago

I have one AMD 3900x plotter and two Intel i7-11700k plotters. I've just updated to the latest plotter and observed increased plot time as well. After digging further it seems that it is not version related, but rather AMD CPU performance varies. Intel plotters have consistent performance over tens of samples: 1800s +-30. AMD plotter varies between 1550s to 1800s. I have powerful fans, I will try setting the fan to 100% on AMD see whether it has any impact.

j-filippovs commented 3 years ago

Just want to share solution in my case. Maybe for someone it would be helpful. After i had all this issues with speed i was searching how to fix it and today i finaly found solution. When type in terminal sudo fstrim -a speed gone up. so instead of 38-45 minutes ploting time now is 28-29 minutes.

chiamb commented 3 years ago

Just want to share solution in my case. Maybe for someone it would be helpful. After i had all this issues with speed i was searching how to fix it and today i finaly found solution. When type in terminal sudo fstrim -a speed gone up. so instead of 38-45 minutes ploting time now is 28-29 minutes.

This is for Linux? On Windows I tried trim option but no diference.

AlenG1977 commented 3 years ago

Can you please explain that in more common language :) maybe give us an example, part of sentence that you wrote?

On Mon, 2 Aug 2021 at 01:08, j-filippovs @.***> wrote:

Just want to share solution in my case. Maybe for someone it would be helpful. After i had all this issues with speed i was searching how to fix it and today i finaly found solution. When type in terminal sudo fstrim -a speed gone up. so instead of 38-45 minutes ploting time now is 28-29 minutes.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/madMAx43v3r/chia-plotter/issues/684#issuecomment-890602356, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOK2OU2UGZMABRSBJ5PEHT3T2XHYHANCNFSM47MEFMFA .

--

Srdačan pozdrav | Best regards | Mit besten Grüßen

Alen Gleđa 063 259 808