search

madMAx43v3r / chia-plotter

Apache License 2.0
2.27k stars 662 forks source link

Ramdisk and SWP #699

Open ArianHiwa opened 3 years ago

ArianHiwa commented 3 years ago

Hi guys

5218r 128gb ./chia_plot -n 28 -r 40 -u 256 -t /mnt/970/ -2 /tmp/ramdisk/ -d /mnt/4tb/

40r 970 pro tmp1 and tmp2 110gb after 2 plots ramdisk not formatting fast enough in p1 , swp goes to 2G and and everything slows down massively there is always 1 tmp file of over 48gb remains in ramdisk

then i get below error due to not enough space Terminate called after throwing an instance of 'std::runtime_error' what(): fopen() failed Aborted (core dumped)

anyone got the same issue?

i ordered 64g more memory plan later will be to add more aand more to have all running on ramdisk

reb0rn21 commented 3 years ago

Only if you click 2x ctrl+c some data stay in temp in ram disk, have no issue with xxx plots over time never run out of space

ArianHiwa commented 3 years ago

20210630_210659 As you can see is already full I didn't close it it and happened after fresh reboot after deleting all tmp

reb0rn21 commented 3 years ago

if ram disk go over 110G mad max should crash at once

ArianHiwa commented 3 years ago

Thanks but none of your comments were helping

reb0rn21 commented 3 years ago

well you just show us htop, you could see if /ramdisk usage is ;)

also you don`t need swap at all, i disabled swap with 110G ramdisk and no issue

also I would suggest to try -r number of phisic core only less ram use and no benefit using logical ones, I run 12 on 5900x

as each thread use I think 0.5G or 0.256 depending on bucket size

with R 40 you might be out of ram and then all go to hell, so run 20 you will not miss any speed

ArianHiwa commented 3 years ago

Thanks Basically after 3 plots all 128g memroy is full and give error above, opening ramdisk there is one or 2 files from past hour which should be deleted. Re created ramdisk but didn't help using Thai guide

https://www.linuxbabe.com/command-line/create-ramdisk-linux/amp

I was at the point to format and reinstall ubuntu.

Thanks will try 20

reb0rn21 commented 3 years ago

I bet its system ram with -r 40, "256 buckets it's about 0.5 GB" so 40*0.5 = 20G + 110G = 130G and you have 128

ArianHiwa commented 3 years ago

thanks now i understood the problem trying 2o then will compare when new 64g kit arrive

gryan315 commented 3 years ago

Try -u 512, that will cut ram used by the process in half, so you'll get another few GB of RAM overhead. When you created your ramdisk, did you use 110g or 110G, because there is a difference. Also, do you have 2x 5218r or just 1? I've seen slightly better performance when using physical core count as -r.