madMAx43v3r / chia-gigahorse

223 stars 31 forks source link

[BUG] Farming reduced less than HALF, after gigahorse-famer. Now more than 10 times!!! #186

Open nicezic opened 1 year ago

nicezic commented 1 year ago

env

after gigahorse-famer, yield less than half!!!

all of harvesters have cpu load less than 1%.

$ lscpu
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   46 bits physical, 48 bits virtual
CPU(s):                          32
On-line CPU(s) list:             0-31
Thread(s) per core:              2
Core(s) per socket:              8
Socket(s):                       2
NUMA node(s):                    2
Vendor ID:                       GenuineIntel
CPU family:                      6
Model:                           45
Model name:                      Intel(R) Xeon(R) CPU E5-2665 0 @ 2.40GHz
Stepping:                        7
CPU MHz:                         1200.000
CPU max MHz:                     3100.0000
CPU min MHz:                     1200.0000
BogoMIPS:                        4799.89
Virtualization:                  VT-x
L1d cache:                       512 KiB
L1i cache:                       512 KiB
L2 cache:                        4 MiB
L3 cache:                        40 MiB
NUMA node0 CPU(s):               0-7,16-23
NUMA node1 CPU(s):               8-15,24-31
$ lscpu
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   46 bits physical, 48 bits virtual
CPU(s):                          72
On-line CPU(s) list:             0-71
Thread(s) per core:              2
Core(s) per socket:              18
Socket(s):                       2
NUMA node(s):                    2
Vendor ID:                       GenuineIntel
CPU family:                      6
Model:                           85
Model name:                      Intel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
Stepping:                        7
CPU MHz:                         2200.000
CPU max MHz:                     2200.0000
CPU min MHz:                     1000.0000
BogoMIPS:                        4400.00
Virtualization:                  VT-x
L1d cache:                       1.1 MiB
L1i cache:                       1.1 MiB
L2 cache:                        36 MiB
L3 cache:                        49.5 MiB
NUMA node0 CPU(s):               0-17,36-53
NUMA node1 CPU(s):               18-35,54-71

@madMAx43v3r What kind of info do you need?

madMAx43v3r commented 1 year ago

How you calculate yield? Solo farming?

nicezic commented 1 year ago

How you calculate yield? Solo farming?

It is Solo farming. average yield for a day.

nicezic commented 1 year ago

@madMAx43v3r any progress?

madMAx43v3r commented 1 year ago

daily yield for solo farming can fluctuate a lot, should average over longer period

nicezic commented 1 year ago

daily yield avg 5 times. now less than 2.5.

nicezic commented 1 year ago

Plot count for all harvesters: 339530 Total size of plots: 26.901 PiB Estimated network space: 27.637 EiB Expected time to win: 5 hours and 41 minutes

madMAx43v3r commented 1 year ago

can you try pool farming to see if there's an issue? or you plotted OG plots?

nicezic commented 1 year ago

self NFP farming, and it has been no problem at all.

Current state: SELF_POOLING
Current state from block height: 767316
Launcher ID: 0388d9e6808507a7fbf77aa047c2bb1c38d3a04160458ee505622d26027dc072
Target address (not for plotting): xch1kpem2jkm0f56x4r5g6ztxe5wck9vj3phs2zaq3d24hx8agj3l7gsj4hh5d
Number of plots: 303703
Owner public key: 84d58bed3b0a5e0fba74bd2a1e3ceeaddc6a761245da65d4539dcdca80ba76a89efe776652535da08e8c543a49f12afb
Pool contract address (use ONLY for plotting - do not send money to this address): xch1m69ezjmf6slau67d83uyt4u8dfjyxpsvg7wxe67e5t8vyjv6ra7qmxm62a
nicezic commented 1 year ago

What do you think about low usage of CPU?

nicezic commented 1 year ago

Can you check of this in config.ymal?

daemon_max_message_size: 50000000

we have a large number of plots... it had a bug in official chia, so official chia added this feature in config.yaml.

Please, check out this link. https://github.com/Chia-Network/chia-blockchain/issues/8061

nicezic commented 1 year ago

we don't use remote harvest feature.

Is there a config of how many CPU or Thread to use for local harvester for compressed plots?

What do you think of the CPU USAGE IS TOO LOW

madMAx43v3r commented 1 year ago

C1 will basically have zero CPU load, that's expected. check the readme for config options: https://github.com/madMAx43v3r/chia-gigahorse/blob/master/chiapos/README.md#list-of-all-options

nicezic commented 1 year ago

Can you check of this in config.ymal?

daemon_max_message_size: 50000000

we have a large number of plots... it had a bug in official chia, so official chia added this feature in config.yaml.

Please, check out this link. https://github.com/Chia-Network/chia-blockchain/issues/8061

nicezic commented 1 year ago

can you check log and config?

nicezic commented 1 year ago

check yourself.. https://xchscan.com/address/xch1dy003zl04gtlmnvejdc9q05uh8r42x0v78cthfq92hkze5jk697saer5cm

chia@chia-farmer:~/.chia/mainnet/log$ grep 'Used farmer reward of block' *
debug.log.1:2023-09-08T02:51:41.181 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4198251 as dev fee (1.5625 % on average)
debug.log.1:2023-09-09T06:28:57.715 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4203509 as dev fee (1.5625 % on average)
debug.log.2:2023-09-02T22:11:58.214 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4174184 as dev fee (1.5625 % on average)
debug.log.2:2023-09-04T20:16:02.938 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4183066 as dev fee (1.5625 % on average)
debug.log.2:2023-09-05T13:48:37.332 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4186485 as dev fee (1.5625 % on average)
debug.log.3:2023-08-30T21:05:07.343 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4160052 as dev fee (1.5625 % on average)
debug.log.4:2023-08-26T02:11:33.731 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4137699 as dev fee (1.5625 % on average)
debug.log.4:2023-08-28T09:44:21.687 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4148527 as dev fee (1.5625 % on average)
debug.log.4:2023-08-29T04:34:56.094 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4152158 as dev fee (1.5625 % on average)
debug.log.5:2023-08-22T09:31:32.892 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4120566 as dev fee (1.5625 % on average)
debug.log.5:2023-08-22T17:42:36.985 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4122197 as dev fee (1.5625 % on average)
debug.log.6:2023-08-17T22:34:27.340 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4100110 as dev fee (1.5625 % on average)
debug.log.6:2023-08-18T22:40:32.923 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4104723 as dev fee (1.5625 % on average)
debug.log.6:2023-08-19T23:43:34.709 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4109545 as dev fee (1.5625 % on average)
debug.log.7:2023-08-14T08:03:30.640 full_node chia.full_node.full_node: WARNING  Used farmer reward of block 4083335 as dev fee (1.5625 % on average)
chia@chia-farmer:~/.chia/mainnet/log$

only 15 times.. for about a month...

Plot count for all harvesters: 339530
Total size of plots: 26.901 PiB
Estimated network space: 27.637 EiB
Expected time to win: 5 hours and 41 minutes

DO YOU THINK THIS IS NORMAL? It has been not farmed for 4 days.

ddubick commented 1 year ago

That message (Used farmer reward) is ONLY logged when the dev fee was taken (avg 1/8 in the case of CPU farming).

madMAx43v3r commented 1 year ago

Correct

nicezic commented 1 year ago

@ddubick okay.

nicezic commented 1 year ago

https://xchscan.com/address/xch1dy003zl04gtlmnvejdc9q05uh8r42x0v78cthfq92hkze5jk697saer5cm check the farming status.

nicezic commented 1 year ago

@madMAx43v3r Can you help me?

nicezic commented 1 year ago

before thte madmax compressed. avg 3~5times... per a day. now It's been 6 days last farmed!!!!

Kruger1981 commented 1 year ago

What is your RAM usage? Also if you set the logs to INFO, do you get any more information of any possible issue?

nicezic commented 1 year ago

@Kruger1981 64G RAM for 100 HDD, other are 16G RAM. INFO logs are fine.

Kruger1981 commented 1 year ago

What is the % of RAM used, for example on the machine with 64GB and 100HDD?

Kruger1981 commented 1 year ago

Also, on your logs, how frequently are you seeing elegible plots like for example: 2023-09-12T19:33:30.332 harvester chia.harvester.harvester: INFO 3 plots were eligible for farming 61e2489423... Found 0 proofs. Time: 0.88635 s. Total 1889 plots

madMAx43v3r commented 1 year ago

Something is def wrong for sure. For such a large farm I would recommend flexfarmer: https://farmer.flexpool.io/

It's quite difficult to debug such an issue without direct access to servers...

nicezic commented 1 year ago

@madMAx43v3r @Kruger1981 I moved famer server to another one, because of wallet is not synced problem.

In addition, I setup and turned on chia_pos and proxy. Then, It farms well, now. https://xchscan.com/address/xch1dy003zl04gtlmnvejdc9q05uh8r42x0v78cthfq92hkze5jk697saer5cm

maybe local CPU harvesting is a problem? I don't know.

madMAx43v3r commented 1 year ago

The Node needs to be synced of course, if there's an issue there you wont farm...

nicezic commented 1 year ago

The Node needs to be synced of course, if there's an issue there you wont farm...

full_node has been always sycned. just wallet not sycned, so I changed farmer server to new one.