madMAx43v3r / chia-plotter

Apache License 2.0
2.28k stars 664 forks source link

Dual E5-2690v1 takes 9 hrs for 1 plot. #307

Open edamame43 opened 3 years ago

edamame43 commented 3 years ago

Specs: Dual E5-2690v1, Supermicro Inter C602 X79, 64G RAM 1600, 2 300G SAS drives as temp1 and temp2. on ubuntu total plot time is 33388 sec, about 9 hrs. ./chia_plot -n 1 -r 32 -u 128 -t /path/to/sas1/ -2 /path/to/sas2/ -d /path/to/finaldir/ -p poolkey -f farmkey Phase 1 CPU usage is at 22%.

Dartellum commented 3 years ago

Comment was on wrong thread.

fgc0109 commented 3 years ago

sas too slow you need ramdisk or nvme ssd i use Dual E5-2689 , 384G ram ,128 buckets , total plot time is 2030s

edamame43 commented 3 years ago

sas too slow you need ramdisk or nvme ssd i use Dual E5-2689 , 384G ram ,128 buckets , total plot time is 2030s

What's your CPU usage ? does it take up all threads?

fgc0109 commented 3 years ago

sas too slow you need ramdisk or nvme ssd i use Dual E5-2689 , 384G ram ,128 buckets , total plot time is 2030s

What's your CPU usage ? does it take up all threads?

yes ,use all of 32 threads about 90% at Phase 1

edamame43 commented 3 years ago

sas too slow you need ramdisk or nvme ssd i use Dual E5-2689 , 384G ram ,128 buckets , total plot time is 2030s

What's your CPU usage ? does it take up all threads?

yes ,use all of 32 threads about 90% at Phase 1

Can you share your command? Even with sas disk, there are ppl who complete a plot in 2 hrs or less.

fgc0109 commented 3 years ago

Can you share your command? Even with sas disk, there are ppl who complete a plot in 2 hrs or less.

./chia_plot -n 1 -r 32 -u 128 -t /mnt/tmpfs/ -d /data/raid01/ -p xxxxxxxxxxxxxxx -f xxxxxxxxxxxxxxxxxxxxxxxxx

/mnt/tmpfs is 300G ramdisk

edelvalle commented 3 years ago

I have this CPU setup and plotting all everything in RAM takes 33min. So, check your SAS drives.

edamame43 commented 3 years ago

I have this CPU setup and plotting all everything in RAM takes 33min. So, check your SAS drives.

Hmmm, strange others can accomplish 80~90min plot with theses sas drives. Looking into it.

edelvalle commented 3 years ago

@edamame43 try something, put each SAS drive on an individual RAID 0 so you can test them individually and check which one is the bad performer. The thing is, if you have a bad performer and you create a RAID where that one is included the access speed tho the RAID will be the access speed of the slowest drive.

edamame43 commented 3 years ago

@edamame43 try something, put each SAS drive on an individual RAID 0 so you can test them individually and check which one is the bad performer. The thing is, if you have a bad performer and you create a RAID where that one is included the access speed tho the RAID will be the access speed of the slowest drive.

I did not use RAID. I have 4 sas drives connected through 1 LSI 9210 card( which does not support R0). I have started 2nd plot using the other 2 sas and see if it makes any difference.

piotrasd commented 3 years ago

install IT firmware for LSI 9210 card then each drive will be separate and create software RAID

madMAx43v3r commented 3 years ago

make sure not to use NTFS in Linux

edamame43 commented 3 years ago

install IT firmware for LSI 9210 card then each drive will be separate and create software RAID

thanks, I'll try

edamame43 commented 3 years ago

make sure not to use NTFS in Linux

Is that why it's so slow?

pavelmakhanko commented 3 years ago

Specs: Dual E5-2690v1, Supermicro Inter C602 X79, 64G RAM 1600, 2 300G SAS drives as temp1 and temp2. on ubuntu total plot time is 33388 sec, about 9 hrs. ./chia_plot -n 1 -r 32 -u 128 -t /path/to/sas1/ -2 /path/to/sas2/ -d /path/to/finaldir/ -p poolkey -f farmkey Phase 1 CPU usage is at 22%.

Did you manage to figure out the problem?

I have a similar problem Config 2 E5520 @ 2.27GHz 16 theards 2 SAS 300GB HP 15 000rpm, each in a separate RAID0 Controller HP P410 latest firmware

Plot creation time 6 hours лог: http://paste.org.ru/?pynbvc

-n 1 -r 16 -u 128 -t /1/ -2 /2/ -d /mnt/sata/drive5/ -p -f

Tell me how to look for a problem?

edamame43 commented 3 years ago

Specs: Dual E5-2690v1, Supermicro Inter C602 X79, 64G RAM 1600, 2 300G SAS drives as temp1 and temp2. on ubuntu total plot time is 33388 sec, about 9 hrs. ./chia_plot -n 1 -r 32 -u 128 -t /path/to/sas1/ -2 /path/to/sas2/ -d /path/to/finaldir/ -p poolkey -f farmkey Phase 1 CPU usage is at 22%.

Did you manage to figure out the problem?

I have a similar problem Config 2 E5520 @ 2.27GHz 16 theards 2 SAS 300GB HP 15 000rpm, each in a separate RAID0 Controller HP P410 latest firmware

Plot creation time 6 hours лог: http://paste.org.ru/?pynbvc

-n 1 -r 16 -u 128 -t /1/ -2 /2/ -d /mnt/sata/drive5/ -p -f

Tell me how to look for a problem?

There is no problem. SAS is too slow.

pavelmakhanko commented 3 years ago

I have this CPU setup and plotting all everything in RAM takes 33min. So, check your SAS drives.

Hmmm, strange others can accomplish 80~90min plot with theses sas drives. Looking into it.

So you, too, found that they quickly plots?

There is a video on YouTube of how 24 plots are received on sas disks a day.

What did you decide in the end?