madMAx43v3r / chia-plotter

Apache License 2.0
2.27k stars 662 forks source link

Problem with dual CPU sockets #602

Open farshidbahmani opened 3 years ago

farshidbahmani commented 3 years ago

I'm using server for plotting

I have two CPU, each one 12 cores and 24 threads (24 cores, 48 threads)

The problem is just 24 threads works for plotting

If is put -r 48 there is no different

Just one of CPUs is working

https://4cut.ir/files/Capture.PNG

chaosue commented 3 years ago
图片

seems ok on linux with -r 30

dominick01234 commented 3 years ago

That’s odd. Maybe one cpu isn’t broken. I have a similar setup. Look at the task manager (in Ubuntu) and see if all cores are working.

On Sun, Jun 20, 2021 at 2:57 PM farshidbahmani @.***> wrote:

I'm using server for plotting

I have two CPU, each one 12 cores and 24 threads (24 cores, 48 threads)

The problem is just 24 threads works for plotting

If is put -r 48 there is no different

Just one of CPUs is working

https://4cut.ir/files/Capture.PNG

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/madMAx43v3r/chia-plotter/issues/602, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB4XLCNSKOCGUYBNYJTW7OLTTZP4NANCNFSM47AOWGAA .

keeehlan commented 3 years ago

I have a T5810 with two CPUs and I haven't noticed any issues plotting with both sockets. I'll monitor more closely.

farshidbahmani commented 3 years ago

@kehlankrumme Is your both CPU high usage in one plotting?

farshidbahmani commented 3 years ago
图片

seems ok on linux with -r 30

Which version? Ubuntu?

Ujang360 commented 3 years ago

I also uses Dell R720xd with 2 CPUs, better check your NUMA nodes @farshidbahmani

cayolblake commented 3 years ago

@Ujang360 planning to get an R720, can you share your CPU model and plotting time?

farshidbahmani commented 3 years ago

@Ujang360 planning to get an R720, can you share your CPU model and plotting time?

HP dl380 g9 E5-2680 v2 x2 192G ram

farshidbahmani commented 3 years ago

I also uses Dell R720xd with 2 CPUs, better check your NUMA nodes @farshidbahmani

I'm testing on Hyper-V, How many NUMA nodes is ok for 192G ram and 48 threads cpu?

asukahan commented 3 years ago

I also uses Dell R720xd with 2 CPUs, better check your NUMA nodes @farshidbahmani

I'm testing on Hyper-V, How many NUMA nodes is ok for 192G ram and 48 threads cpu?

I have many problems with mining with windows 10 on my Dual 2697V2 with 128G ram, so i jumped to ubuntu and time cost of table 1-1 dropped from 35 seconds to 11 seconds. my advice is to use ubuntu, or any linux you feel familiar with.

elaaar commented 3 years ago

I have other problem with dual CPU, The Plotter is starting and hang all time in step one. Bucket files are filled but no progress in cmd (Windows 10pro) 2x x5690 with supermicro Board and 192gb ram.

farshidbahmani commented 3 years ago

I installed Hyper-V, now all cores works

I have other problem with dual CPU, The Plotter is starting and hang all time in step one. Bucket files are filled but no progress in cmd (Windows 10pro) 2x x5690 with supermicro Board and 192gb ram.

Do you have ramdisk? how many threads did you set? what is your madmax config?

elaaar commented 3 years ago

No ramdisk, Standard config with 20threads. Same config, run on a i9 Desktop System perfekt.

chaosue commented 3 years ago
图片

seems ok on linux with -r 30

Which version? Ubuntu?

debian 10, E5-2630 v3 x 2 , 283G ram on dell R730.

chiair commented 3 years ago

I also have exactly this problem, does it have a solution? E5 2697v2 24core 48 threads but Only half of it works.

farshidbahmani commented 3 years ago

I also uses Dell R720xd with 2 CPUs, better check your NUMA nodes @farshidbahmani

I disabled NUMA, now both of CPUs works, But time for plotting increased , almost 2x

I think i should fill all slots RAM with 24 Rams, 12 for one of CPU and 12 for other one In this case CPU can manage all of bus

I'll test and tell the result here

Ujang360 commented 3 years ago

I disabled NUMA, now both of CPUs works, But time for plotting increased , almost 2x

I think i should fill all slots RAM with 24 Rams, 12 for one of CPU and 12 for other one In this case CPU can manage all of bus

I'll test and tell the result here

Cool, I also disable NUMA (or single node) since I have uniform RAMs @farshidbahmani. Also single rank RAM is faster, maybe about 10% improvements

@Ujang360 planning to get an R720, can you share your CPU model and plotting time?

@cayolblake about 30 minutes using NVMe in RAID0 (no RAM drive) per plot

NikXO6 commented 3 years ago

I also uses Dell R720xd with 2 CPUs, better check your NUMA nodes @farshidbahmani

I'm testing on Hyper-V, How many NUMA nodes is ok for 192G ram and 48 threads cpu?

I have many problems with mining with windows 10 on my Dual 2697V2 with 128G ram, so i jumped to ubuntu and time cost of table 1-1 dropped from 35 seconds to 11 seconds. my advice is to use ubuntu, or any linux you feel familiar with.

Can confirm, have the same spec. Went for 52mins per plot on windows to 24mins on ubuntu. The windows build doesn't always work with multi cpu machine, only way I got it running was over hyper V and had to 88 threads to use both cpus, but IO was hit very bad and was not viable.

farshidbahmani commented 3 years ago

I solved it

I can just say windows is shit... i'm sorry

I installed CentOs7 and CPUFreq extension then turned on frequency boost in extension Now both CPUs is working on high frequency, And my creation plot time decreased from 70 min to 30 min