Still crashing at "Sorting F7 and writing C tables" despite Fix 251

[Qwinn1]

Forked master and then manually applied Fix 251 (since it still seems to only be in develop branch). Still crashing at "Sorting F7 and writing C tables" when running on 512 buckets. It can actually still happen with 256 buckets too - for me, on a run of 15 plots, it crashed in the same spot on the 11th plot. So not frequent, but not that rare either.

This is on Windows 10, 7950x processor which has 32 threads available, I only used 24, 100G cache. Getting 20.7 minute plots with 256 buckets. Phase 1 Tables 1-7 do seem to go a bit faster with 512 buckets (256 - 476 seconds, 512 - 459.5 seconds) but, then, crash.

This is the command I used to test (only difference between the two test runs for those times was the -b 512):

.\bladebit.exe -n 1 -t 24 -p blahblahblah -f blahblahblah diskplot -a --cache 100G -b 512 -t1 C:\bladebit\bladebit1\ C:\bladebit\FinishedPlots\ >> C:\bladebit\bladebit.log

[majekqwert]

I have the same problem, with bucket 256 and 100GB Cache. Sometimes it works for 1-2 days without a problem, and sometimes it just crashes after 2-3 hours

[hanggrian]

I'm getting similar issue with macOS, this is my 3rd attempt with the same result.

Increasing the file limit from 10496 to 4294967295

Bladebit Chia Plotter
Version      : 2.0.1
Git Commit   : 9fac46aff0476e829d476412de18497a3a2f7ed8
Compiled With: clang 13.0.0

[Global Plotting Config]
 Will create 1 plots.
 Thread count          : 12
 Warm start enabled    : false
 NUMA disabled         : false
 CPU affinity disabled : false
 Farmer public key     : 90d43c7a4cb1a004a9b61e07a765c829d0a6e9c63492b10f538f700a0d2d11bc229211c84a463a4988cb6de4ac304efc
 Pool public key       : 940d5e844e1293d8a3e3440a7e62fb41c1fdaf76d52a49b2afc5929eea7151ca4ef7005fe8334e797acd2f921d1ced61
 Output path           : /Volumes/Media/Chia/Final

[Bladebit Disk Plotter]
 Heap size      : 3.45 GiB ( 3530.05 MiB )
 Cache size     : 0.00 GiB ( 0.00 MiB )
 Bucket count   : 256
 Alternating I/O: false
 F1  threads    : 12
 FP  threads    : 12
 C   threads    : 12
 P2  threads    : 12
 P3  threads    : 12
 I/O threads    : 1
 Temp1 block sz : 262144
 Temp2 block sz : 262144
 Temp1 path     : /Volumes/Media/Chia/Temporary
 Temp2 path     : /Volumes/Media/Chia/Temporary
 I/O metrices enabled.
 Allocating memory
Warning: vm_wire() failed with error: 22 .

Generating plot 1 / 1: e9b8b618a6b864e4bda3ffe7421b75c2a945ef73752043eca69515baf14882fe

Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Started plot.
Running Phase 1
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Warning: vm_wire() failed with error: 22 .
Table 1: F1 generation
Generating f1...
Finished f1 generation in 323.46 seconds.
Progress update: 0.01
Table 1 I/O wait time: 323.46 seconds.
 Table 1 Disk Write Metrics:
  Average write throughput 202.45 MiB ( 212.29 MB ) or 0.20 GiB ( 0.21 GB ).
  Total size written: 65467.00 MiB ( 68647.13 MB ) or 63.93 GiB ( 68.65 GB ).
  Total write commands: 513.

Table 2
 Sorting      : Completed in 61.00 seconds.
 Distribution : Completed in 559.80 seconds.
 Matching     : Completed in 73.53 seconds.
 Fx           : Completed in 63.55 seconds.
Completed table 2 in 1803.67 seconds with 4294911821 entries.
Progress update: 0.06
Table 2 I/O wait time: 1056.88 seconds.
 Table 2 I/O Metrics:
  Average read throughput 62.43 MiB ( 65.46 MB ) or 0.06 GiB ( 0.07 GB ).
  Total size read: 65467.00 MiB ( 68647.12 MB ) or 63.93 GiB ( 68.65 GB ).
  Total read commands: 131072.
  Average write throughput 197.17 MiB ( 206.74 MB ) or 0.19 GiB ( 0.21 GB ).
  Total size written: 148375.75 MiB ( 155583.25 MB ) or 144.90 GiB ( 155.58 GB ).
  Total write commands: 1281.

Table 3
 Sorting      : Completed in 81.37 seconds.
 Distribution : Completed in 623.07 seconds.
 Matching     : Completed in 54.45 seconds.
 Fx           : Completed in 63.91 seconds.
Completed table 3 in 3972.36 seconds with 4294826937 entries.
Progress update: 0.12
Table 3 I/O wait time: 1599.16 seconds.
 Table 3 I/O Metrics:
  Average read throughput 68.91 MiB ( 72.26 MB ) or 0.07 GiB ( 0.07 GB ).
  Total size read: 114583.75 MiB ( 120149.77 MB ) or 111.90 GiB ( 120.15 GB ).
  Total read commands: 196608.
  Average write throughput 83.88 MiB ( 87.96 MB ) or 0.08 GiB ( 0.09 GB ).
  Total size written: 193420.50 MiB ( 202816.09 MB ) or 188.89 GiB ( 202.82 GB ).
  Total write commands: 66562.

Table 4
 Sorting      : Completed in 83.91 seconds.
 Distribution : Completed in 603.15 seconds.
 Matching     : Completed in 53.50 seconds.
 Fx           : Completed in 65.50 seconds.
Completed table 4 in 4216.59 seconds with 4294556183 entries.
Progress update: 0.2
Table 4 I/O wait time: 1566.32 seconds.
 Table 4 I/O Metrics:
  Average read throughput 82.60 MiB ( 86.62 MB ) or 0.08 GiB ( 0.09 GB ).
  Total size read: 147341.25 MiB ( 154498.50 MB ) or 143.89 GiB ( 154.50 GB ).
  Total read commands: 196608.
  Average write throughput 79.63 MiB ( 83.50 MB ) or 0.08 GiB ( 0.08 GB ).
  Total size written: 193397.25 MiB ( 202791.71 MB ) or 188.86 GiB ( 202.79 GB ).
  Total write commands: 66562.

Table 5
 Sorting      : Completed in 80.70 seconds.
 Distribution : Completed in 604.37 seconds.
 Matching     : Completed in 53.64 seconds.
 Fx           : Completed in 65.36 seconds.
Completed table 5 in 3857.44 seconds with 4294099403 entries.
Progress update: 0.28
Table 5 I/O wait time: 1592.49 seconds.
 Table 5 I/O Metrics:
  Average read throughput 81.14 MiB ( 85.08 MB ) or 0.08 GiB ( 0.09 GB ).
  Total size read: 147319.50 MiB ( 154475.69 MB ) or 143.87 GiB ( 154.48 GB ).
  Total read commands: 196608.
  Average write throughput 94.89 MiB ( 99.49 MB ) or 0.09 GiB ( 0.10 GB ).
  Total size written: 193358.75 MiB ( 202751.34 MB ) or 188.83 GiB ( 202.75 GB ).
  Total write commands: 66562.

Table 6
 Sorting      : Completed in 80.95 seconds.
 Distribution : Completed in 434.89 seconds.
 Matching     : Completed in 48.85 seconds.
 Fx           : Completed in 62.83 seconds.
Completed table 6 in 3156.49 seconds with 4293222809 entries.
Progress update: 0.36
Table 6 I/O wait time: 1416.43 seconds.
 Table 6 I/O Metrics:
  Average read throughput 82.02 MiB ( 86.01 MB ) or 0.08 GiB ( 0.09 GB ).
  Total size read: 147284.75 MiB ( 154439.25 MB ) or 143.83 GiB ( 154.44 GB ).
  Total read commands: 196608.
  Average write throughput 118.42 MiB ( 124.17 MB ) or 0.12 GiB ( 0.12 GB ).
  Total size written: 160569.25 MiB ( 168369.06 MB ) or 156.81 GiB ( 168.37 GB ).
  Total write commands: 66562.

Table 7
 Sorting      : Completed in 76.65 seconds.
 Distribution : Completed in 213.78 seconds.
 Matching     : Completed in 48.27 seconds.
 Fx           : Completed in 60.78 seconds.
Completed table 7 in 2525.77 seconds with 4291376816 entries.
Progress update: 0.42
Table 7 I/O wait time: 1224.08 seconds.
 Table 7 I/O Metrics:
  Average read throughput 68.41 MiB ( 71.73 MB ) or 0.07 GiB ( 0.07 GB ).
  Total size read: 114502.00 MiB ( 120064.05 MB ) or 111.82 GiB ( 120.06 GB ).
  Total read commands: 196608.
  Average write throughput 131.71 MiB ( 138.10 MB ) or 0.13 GiB ( 0.14 GB ).
  Total size written: 111461.00 MiB ( 116875.33 MB ) or 108.85 GiB ( 116.88 GB ).
  Total write commands: 66306.

Sorting F7 & Writing C Tables