madMAx43v3r / chia-gigahorse

220 stars 32 forks source link

Gigahorse-3.0 2.1.4-giga31: sporadic ANS decode failed with: Destination buffer is too small (pos=1723857) (642) #286

Closed ghmgit closed 3 months ago

ghmgit commented 3 months ago

Hi,

this error is logged for different plots. Please let me know if this can happen or is a problem?

2024-03-14T17:09:03.637 harvester chia.harvester.harvester: ERROR Exception fetching qualities for /.../plot-k32-c30-2024-03-10-19-51-xxx.plot: ANS decode failed with: Destination buffer is too small (pos=1723857) (642) PlotInfo(prover=<chiapos.DiskProver object at 0x7f0a6c6bb830>, pool_public_key=None, pool_contract_puzzle_hash=, plot_public_key=, file_size=46506484272, time_modified=1710100969.7660136)


[root@machine log]# grep "ANS decode" debug.log |tr : - |tr / - |cut -d- -f1-6,8-15,17- |cut -dP -f1 |cat -n
     1  2024-03-12T15-04-59.559 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-09-23-03- ANS decode failed with- Destination buffer is too small (pos=1722898) (642) 
     2  2024-03-12T16-43-04.930 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-10-10-12- ANS decode failed with- Destination buffer is too small (pos=1723849) (642) 
     3  2024-03-12T20-17-36.688 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-23-42- ANS decode failed with- Destination buffer is too small (pos=1723713) (642) 
     4  2024-03-13T00-03-02.176 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-00-31- ANS decode failed with- Destination buffer is too small (pos=1723622) (642) 
     5  2024-03-13T02-25-23.440 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-10-08-45- ANS decode failed with- Destination buffer is too small (pos=1723756) (642) 
     6  2024-03-13T02-47-05.878 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-01-37- ANS decode failed with- Destination buffer is too small (pos=1724308) (642) 
     7  2024-03-13T07-10-39.894 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-10-12-45- ANS decode failed with- Destination buffer is too small (pos=1723722) (642) 
     8  2024-03-13T10-38-39.826 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-21-36- ANS decode failed with- Destination buffer is too small (pos=1723290) (642) 
     9  2024-03-13T13-30-07.356 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-11-14- ANS decode failed with- Destination buffer is too small (pos=1723282) (642) 
    10  2024-03-13T16-38-33.604 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-15-31- ANS decode failed with- Destination buffer is too small (pos=1724113) (642) 
    11  2024-03-13T17-31-19.302 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-02-53- ANS decode failed with- Destination buffer is too small (pos=1723991) (642) 
    12  2024-03-13T20-29-01.793 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-01-39- ANS decode failed with- Destination buffer is too small (pos=1723477) (642) 
    13  2024-03-13T22-02-21.111 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-02-08- ANS decode failed with- Destination buffer is too small (pos=1723732) (642) 
    14  2024-03-13T22-42-34.390 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-18-03- ANS decode failed with- Destination buffer is too small (pos=1723827) (642) 
    15  2024-03-13T22-42-49.684 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-18-03- ANS decode failed with- Destination buffer is too small (pos=1723827) (642) 
    16  2024-03-14T00-12-48.278 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-11-14- ANS decode failed with- Destination buffer is too small (pos=1723609) (642) 
    17  2024-03-14T00-16-44.102 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-13-13- ANS decode failed with- Destination buffer is too small (pos=1723990) (642) 
    18  2024-03-14T01-06-31.020 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-05-05- ANS decode failed with- Destination buffer is too small (pos=1723761) (642) 
    19  2024-03-14T04-41-05.532 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-08-54- ANS decode failed with- Destination buffer is too small (pos=1723784) (642) 
    20  2024-03-14T04-55-48.036 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-09-31- ANS decode failed with- Destination buffer is too small (pos=1723261) (642) 
    21  2024-03-14T05-19-53.407 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-10-10-02- ANS decode failed with- Destination buffer is too small (pos=1724088) (642) 
    22  2024-03-14T06-35-08.319 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-18-28- ANS decode failed with- Destination buffer is too small (pos=1723719) (642) 
    23  2024-03-14T08-22-16.023 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-09-13- ANS decode failed with- Destination buffer is too small (pos=1723559) (642) 
    24  2024-03-14T08-58-10.318 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-06-23- ANS decode failed with- Destination buffer is too small (pos=1724051) (642) 
    25  2024-03-14T12-00-47.817 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-11-19-45- ANS decode failed with- Destination buffer is too small (pos=1723746) (642) 
    26  2024-03-14T12-14-59.083 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-15-43- ANS decode failed with- Destination buffer is too small (pos=1723870) (642) 
    27  2024-03-14T12-41-23.761 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-12-07-57- ANS decode failed with- Destination buffer is too small (pos=1723861) (642) 
    28  2024-03-14T17-09-03.637 harvester chia.harvester.harvester- ERROR    Exception fetching qualities for -plot-k32-c30-2024-03-10-19-51- ANS decode failed with- Destination buffer is too small (pos=1723857) (642) 
ghmgit commented 3 months ago

it is using this recompute server:


hu Mar 14 18:43:45 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.113.01             Driver Version: 535.113.01   CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce RTX 4070 Ti     Off | 00000000:02:00.0 Off |                  N/A |
| 65%   77C    P2             254W / 285W |   3990MiB / 12282MiB |    100%  Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage  |
|=======================================================================================|
|    0   N/A  N/A      3093  G   /usr/libexec/Xorg                            27MiB |
|    0   N/A  N/A      3483  G   /usr/bin/gnome-shell                         31MiB |
|    0   N/A  N/A      4511  C   ...mpute_server-955f9c1-GH31-09mar2023     3914MiB |
+---------------------------------------------------------------------------------------+
madMAx43v3r commented 3 months ago

This issue is fixed in latest plotter versions. 0.005% of each plot was corrupted with this error before.

I would just ignore it, and update plotter. No need to replot old plots ;)

BTW: This bug has been there since GH 1.0, and GH 2.0 had it as well.

ghmgit commented 3 months ago

Can you confirm this affects every plot, or only the plots which report this error?

For new plots I am already using 3.0.4: | 0 N/A N/A 1035434 C ...plot_k32_v3-d7a9c44-3.0.4-14mar2024 3998MiB |

madMAx43v3r commented 3 months ago

It affects every plot equally, made with the older plotters. The chance to get the ERROR is random when farming (since each plot has it's own challenge, so the lookups are different).

ghmgit commented 3 months ago

Thanks for clarification.