search

Chia-Network / bladebit

A high-performance k32-only, Chia (XCH) plotter supporting in-RAM and disk-based plotting
Apache License 2.0
337 stars 108 forks source link

3.1.0 - Invalid Plots generated using --disk16 parameter (Ubuntu 22.04) #439

Open jiongxuan opened 10 months ago

jiongxuan commented 10 months ago

Hi, I am using Ubuntu 22.04, GPU plotting to generate a compressed plot, disk 16 mode, compression level C1. The generation process was all normal, but when using the --check 1000 parameter to check these Plots, it was found that the "invalid proof ratio" reached 55%.

Among them, because a Cuda out of memory error occurred during the process, I followed the instructions in issue #276 and changed the parameters (BBCU_BUCKET_COUNT) from 128u to 256u.

Please help me find out what is the reason and how to solve it. Thanks!

My hardware:

GPU: NVidia 3060 Laptop (6Gib vram) RAM: 16Gib SSD: NVMe 512G System: Ubuntu 22.02 Cuda: 12.0.1

Commands and logs: (Keys hidden)

./bladebit_cuda -z 1 -f b818... -c xch10... cudaplot --disk-16 --check 1000 -t1 ~/Documents/ChiaTemp ~/Documents/ChiaPlotsNew

Bladebit Chia Plotter Version : 3.1.0-dev Git Commit : e9836f8bd963321457bc86eb5d61344bfb76dcf0 Compiled With: gcc 11.4.0

[Global Plotting Config] Will create 1 plots. Thread count : 16 Warm start enabled : false NUMA disabled : false CPU affinity disabled : false Farmer public key : b818... Pool contract address : xch10... Compression Level : 1 Benchmark mode : disabled Warning: 16G mode is experimental and still under development. Please use the --check parameter to validate plots when using this mode. Direct I/O not supported in 16G mode at the moment. Disabing it.

[Bladebit CUDA Plotter] Host RAM : 15 GiB Plot checks : enabled ( 1000 ) Plot check threshold: 0.600

Selected cuda device 0 : NVIDIA GeForce RTX 3060 Laptop GPU CUDA Compute Capability : 8.6 SM count : 30 Max blocks per SM : 16 Max threads per SM : 1536 Async Engine Count : 2 L2 cache size : 3.00 MB L2 persist cache max size : 2.25 MB Stack Size : 1.00 KB Memory: Total : 5.80 GB Free : 5.68 GB

Allocating buffers (this may take a few seconds)... Kernel RAM required : 2557364432 bytes ( 2438.89 MiB or 2.38 GiB ) Intermediate RAM required : 2315526144 bytes ( 2208.26 MiB or 2.16 GiB ) Host RAM required : 2147483648 bytes ( 2048.00 MiB or 2.00 GiB ) Total Host RAM required : 4704848080 bytes ( 4486.89 MiB or 4.38 GiB ) GPU RAM required : 5585768448 bytes ( 5327.00 MiB or 5.20 GiB ) Allocating buffers... Done.

Generating plot 1 / 1: 1b270cd8deb1f57f68d555d6e5514c04f9fb990e0a6c813ab6b43d83cc328b6a Plot temporary file: /home/aaa/Documents/ChiaPlotsNew/plot-k32-c01-2023-11-18-01-38-1b270cd8deb1f57f68d555d6e5514c04f9fb990e0a6c813ab6b43d83cc328b6a.plot.tmp

Generating F1 Finished F1 in 67.73 seconds. Table 2 completed in 222.39 seconds with 4294889465 entries. Table 3 completed in 342.50 seconds with 4294750322 entries. Table 4 completed in 420.01 seconds with 4294505025 entries. Table 5 completed in 388.82 seconds with 4294074464 entries. Table 6 completed in 373.89 seconds with 4292932808 entries. Table 7 completed in 314.62 seconds with 4290890159 entries. Finalizing Table 7 Finalized Table 7 in 126.11 seconds. Completed Phase 1 in 2256.23 seconds Marked Table 6 in 15.07 seconds. Marked Table 5 in 12.22 seconds. Marked Table 4 in 12.45 seconds. Marked Table 3 in 12.66 seconds. Completed Phase 2 in 52.40 seconds Compressing Table 2 and 3... Step 1 completed step in 178.79 seconds. Step 2 completed step in 185.01 seconds. Completed table 2 in 363.81 seconds with 3439490657 / 4294750322 entries ( 80.09% ). Compressing tables 3 and 4... Step 1 completed step in 161.52 seconds. Step 2 completed step in 208.98 seconds. Step 3 completed step in 162.15 seconds. Completed table 3 in 532.75 seconds with 3465395293 / 4294505025 entries ( 80.69% ). Compressing tables 4 and 5... Step 1 completed step in 98.62 seconds. Step 2 completed step in 199.75 seconds. Step 3 completed step in 161.29 seconds. Completed table 4 in 459.71 seconds with 3531741771 / 4294074464 entries ( 82.25% ). Compressing tables 5 and 6... Step 1 completed step in 89.37 seconds. Step 2 completed step in 199.53 seconds. Step 3 completed step in 170.83 seconds. Completed table 5 in 459.74 seconds with 3711415126 / 4292932808 entries ( 86.45% ). Compressing tables 6 and 7... Step 1 completed step in 95.61 seconds. Step 2 completed step in 209.04 seconds. Step 3 completed step in 176.45 seconds. Completed table 6 in 481.11 seconds with 4290890159 / 4290890159 entries ( 100.00% ). Serializing P7 entries Completed serializing P7 entries in 90.44 seconds. Completed Phase 3 in 2387.64 seconds Completed Plot 1 in 4696.27 seconds ( 78.27 minutes )

Checking 1000 random proofs with seed 0x71c40627fcaaad9138a40934ba743156df0335ee8d1f3a07fad207c0075cd74b... Plot compression level: 1 10%... 20%... 30%... 40%... 50%... 60%... 70%... 80%... 90%... Seed used: 0x71c40627fcaaad9138a40934ba743156df0335ee8d1f3a07fad207c0075cd74b Proofs requested/fetched: 536 / 1000 ( 53.600% ) Proof fetches failed : 2 ( 0.200% ) Proof validation failed : 512 ( 51.200% )

WARNING: Deleting plot '/home/aaa/Documents/ChiaPlotsNew/plot-k32-c01-2023-11-18-01-38-1b270cd8deb1f57f68d555d6e5514c04f9fb990e0a6c813ab6b43d83cc328b6a.plot.tmp' as it failed to fetch some proofs. This might indicate corrupt plot file.

Completed writing plot in 20.28 seconds