search

madMAx43v3r / chia-plotter

Apache License 2.0
2.27k stars 662 forks source link

MadMax-plotter crashes because the disk with the temporary folder is full. #800

Closed funstuk closed 3 years ago

funstuk commented 3 years ago

Hi! The problem appeared after the update. On a random cycle, a fast disk with a temporary folder fills up to 100%, as a result of which an error appears. Temporary folders are located on a 340GB ram disk.

root@b2:~/chia-plotter/build# df -h /mnt/ramdisk/
Filesystem      Size  Used Avail Use% Mounted on
tmpfs           340G  340G     0 100% /mnt/ramdisk

I've tried various options:

./chia_plot -n -1 -r 40 -u 256 -t /mnt/ramdisk/temp_1/ -2 /mnt/ramdisk/temp_2/ -d /mnt/r0_cl-2/plots/ -f * -c *

./chia_plot -n -1 -r 40 -u 256 -t /mnt/ramdisk/ -2 /mnt/ramdisk/ -d /mnt/r0_cl-2/plots/ -f * -c *

Output:

Phase 4 took 61.1601 sec, final plot size is 108835798106 bytes
Total plot creation time was 1609.84 sec (26.8307 min)
Started copy to /mnt/r0_cl-2/plots/plot-k32-2021-07-11-21-20-*.plot
Crafting plot 5 out of -1
Process ID: 3758074
Number of Threads: 40
Number of Buckets P1:    2^8 (256)
Number of Buckets P3+P4: 2^8 (256)
Pool Puzzle Hash:  *
Farmer Public Key: *
Working Directory:   /mnt/ramdisk/temp_1/
Working Directory 2: /mnt/ramdisk/temp_2/
Plot Name: plot-k32-2021-07-11-21-47-*
[P1] Table 1 took 11.5479 sec
[P1] Table 2 took 102.139 sec, found 4295020756 matches
[P1] Table 3 took 116.303 sec, found 4295070615 matches
[P1] Table 4 took 136.076 sec, found 4295069851 matches
[P1] Table 5 took 134.704 sec, found 4294985763 matches
[P1] Table 6 took 128.277 sec, found 4294807397 matches
[P1] Table 7 took 102.534 sec, found 4294538785 matches
Phase 1 took 731.595 sec
[P2] max_table_size = 4295070615
[P2] Table 7 scan took 6.64808 sec
[P2] Table 7 rewrite took 51.6556 sec, dropped 0 entries (0 %)
[P2] Table 6 scan took 24.6531 sec
[P2] Table 6 rewrite took 36.599 sec, dropped 581322344 entries (13.5355 %)
[P2] Table 5 scan took 23.6685 sec
[P2] Table 5 rewrite took 47.1512 sec, dropped 762053544 entries (17.7429 %)
[P2] Table 4 scan took 23.2979 sec
[P2] Table 4 rewrite took 50.5342 sec, dropped 828990255 entries (19.301 %)
[P2] Table 3 scan took 23.2824 sec
[P2] Table 3 rewrite took 52.0676 sec, dropped 855192583 entries (19.911 %)
[P2] Table 2 scan took 23.1806 sec
terminate called after throwing an instance of 'std::runtime_error'
  what():  thread failed with: thread failed with: fwrite() failed
Aborted (core dumped)

Last 10 files in temporary directories:

root@b2:~/chia-plotter/build# ls -l1h /mnt/ramdisk/temp_1 | tail -n 10
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_91.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_92.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_93.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_94.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_95.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_96.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_97.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_98.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_99.tmp
-rw-r--r-- 1 root root 169M Jul 11 22:01 plot-k32-2021-07-11-21-47-*.p2.t6.sort_bucket_9.tmp
root@b2:~/chia-plotter/build# ls -l1h /mnt/ramdisk/temp_2 | tail -n 10
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_92.tmp
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_93.tmp
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_94.tmp
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_95.tmp
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_96.tmp
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_97.tmp
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_98.tmp
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_99.tmp
-rw-r--r-- 1 root root 135M Jul 11 22:06 plot-k32-2021-07-11-21-47-*.p2.t2.sort_bucket_9.tmp
-rw-r--r-- 1 root root  40G Jul 11 22:00 plot-k32-2021-07-11-21-47-*.p2.table7.tmp
funstuk commented 3 years ago

It seems the problem was in the slow destination folder.