search

EasyX-Community / easyNOMP

EasyNOMP - The easy NOMP mining pool - Minor development under way
https://pool.easyx.cc
GNU General Public License v2.0
56 stars 63 forks source link

Work Queue Depth Exceeded - payments stuck #161

Closed mooleshacat closed 5 years ago

mooleshacat commented 5 years ago

maxBatchTransactions is not fix.

Payments for RAP got stuck, my guess is inputs/outputs problem. Cannot locate related issues ATM.

Payments got stuck, nrelated to settings within wallet config

Details:

2|pool  | 2018-11-07 13:07:39 -05:00: [2018-11-07T18:07:39.750Z] [warn] [rapture] [CoinDaemon] : Daemon returned unexpected return code 500, data = "Work queue depth exceeded"
2|pool  | 2018-11-07 13:07:39 -05:00: [2018-11-07T18:07:39.751Z] [warn] [rapture] [CoinDaemon] : Daemon returned unexpected return code 500, data = "Work queue depth exceeded"
2|pool  | 2018-11-07 13:07:39 -05:00: [2018-11-07T18:07:39.751Z] [warn] [rapture] [CoinDaemon] : Daemon returned unexpected return code 500, data = "Work queue depth exceeded"
2|pool  | 2018-11-07 13:07:39 -05:00: [2018-11-07T18:07:39.751Z] [warn] [rapture] [CoinDaemon] : Daemon returned unexpected return code 500, data = "Work queue depth exceeded"

Related Issues: https://github.com/bitcoin/bitcoin/issues/14578 https://github.com/z-classic/z-nomp/issues/127 https://github.com/foxer666/node-open-mining-portal/issues/106 https://github.com/foxer666/node-open-mining-portal/issues/148 https://github.com/foxer666/node-open-mining-portal/issues/95

mooleshacat commented 5 years ago

More debug data:

2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.189Z] [info] [mogwaicoin] [PaymentProcessor] : No workers was chosen for paying out
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.190Z] [info] [ravencoin] [PaymentProcessor] : No workers was chosen for paying out
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.191Z] [info] [securetag] [PaymentProcessor] : No workers was chosen for paying out
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.214Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199675 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.221Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199676 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.233Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199689 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.235Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199685 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.237Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199678 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.239Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199668 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.242Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199671 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.246Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199665 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.248Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199666 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.249Z] [warn] [rapturecoin] [Pool [:1]] : Unknown stratum method from RAKXD9w7fJW8ghFeswg2B7J6dMDFGQ9ahH.BOX1 [::ffff:108.170.129.156]: mining.extranonce.subscribe
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.261Z] [info] [rapturecoin] [PaymentProcessor] : We have found confirmed block #199683 ready for payout
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.267Z] [info] [rapturecoin] [PaymentProcessor] : Worker RAKXD9w7fJW8ghFeswg2B7J6dMDFGQ9ahH have reached minimum payout threshold (2.75315609107597805909 above minimum 0.5)
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.271Z] [info] [rapturecoin] [PaymentProcessor] : Worker RSSct24c8bYqPJtEfSTYwU9p5mWxEMo3m4 have reached minimum payout threshold (27.01062350892402194091 above minimum 0.5)
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.274Z] [info] [rapturecoin] [PaymentProcessor] : Payments to miners: {"RAKXD9w7fJW8ghFeswg2B7J6dMDFGQ9ahH":"2.7531560910759780590912401416","RSSct24c8bYqPJtEfSTYwU9p5mWxEMo3m4":"27.0106235089240219409087598584"}
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.277Z] [info] [rapturecoin] [PaymentProcessor] : Ok, going to pay from "pool" address with final amounts: {"RAKXD9w7fJW8ghFeswg2B7J6dMDFGQ9ahH":2.75315609,"RSSct24c8bYqPJtEfSTYwU9p5mWxEMo3m4":27.0106235}
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.277Z] [info] [rapturecoin] [PaymentProcessor] : Ok, going to pay FEES from "RAKXD9w7fJW8ghFeswg2B7J6dMDFGQ9ahH,RSSct24c8bYqPJtEfSTYwU9p5mWxEMo3m4" addresses: ["RAKXD9w7fJW8ghFeswg2B7J6dMDFGQ9ahH","RSSct24c8bYqPJtEfSTYwU9p5mWxEMo3m4"]
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.333Z] [warn] [rapturecoin] [CoinDaemon] : Daemon returned unexpected return code 500, data = "Work queue depth exceeded"
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.335Z] [warn] [rapturecoin] [CoinDaemon] : Daemon returned unexpected return code 500, data = "Work queue depth exceeded"
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.336Z] [warn] [rapturecoin] [CoinDaemon] : Daemon returned unexpected return code 500, data = "Work queue depth exceeded"
2|pool  | 2018-11-07 18:33:46 -05:00: [2018-11-07T23:33:46.337Z] [warn] [rapturecoin] [CoinDaemon] : Daemon returned unexpected return code 500, data = "Work queue depth exceeded"

This will affect coins that are newer, where blocks are found more frequently

*Best thing you can do to mitigate is temporary edit pool_configs/:**

"paymentInterval": 120,
 "minimumPayment": 0,

I should resume work on PaymentProcessor ASAP.

mooleshacat commented 5 years ago

This is the "work queue depth exceeded" error and fix is actually here https://github.com/bitpay/insight-api/issues/492#issuecomment-241448761

Adjusting configs, will put this in the documentation

MAKE SURE YOUR WALLETD HAS THE FOLLOWING ADJUSTMENTS (replace < n> with value): rpcworkqueue=< n> rpcthreads=< n> rpctimeout=< n>

I will revert my payment processor changes back and test again ASAP.

mooleshacat commented 5 years ago

These are default values, use them as baseline to adjust your own. For a pool, you will want to increase number of threads, and work queue.

Default values: static const int DEFAULT_HTTP_THREADS=4; static const int DEFAULT_HTTP_WORKQUEUE=16; static const int DEFAULT_HTTP_SERVER_TIMEOUT=30;

topben commented 5 years ago

i tested it, but still doesn't work ReferenceError: paymentsData is not defined

mooleshacat commented 5 years ago

@everyone I have changed the code back to original. Please run git pull and make changes mentioned in comment https://github.com/leshacat/EasyNOMP/issues/161#issuecomment-440648360 and you should get payments working again.

===============================

@topwuo That error is not related to this issue. Please create a new issue for it.

Is that the entire error? Ususally it says line number and filename... Can you paste entire error please? Please also paste output of git status

Also please try git checkout master; git pull because I suspect you are not on master branch. Master is currently working and running on EasyX pool...

mooleshacat commented 5 years ago

Confirmed payments working again... Change the following settings from their defaults:

rpcworkqueue=16
rpcthreads=4
rpctimeout=30

Example:

rpcworkqueue=100
rpcthreads=4
rpctimeout=30

You may need to git checkout master; git pull to get up to date code.