I am running Windows Core v1.4.0. Yesterday night, staking was OK. Tonight, I do not see any staking info. Looking at the logs show:
**====== Async loops ====== [Running: 229] [Faulted: 1]
Name Type Health
PartialValidator Dequeuer Faulted
Fault Reason: Lock held by thread 20 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace()
at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82
at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessTransaction(String walletName, Transaction transaction, uint256 fixedTxId) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 1112
at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessTransaction(Transaction transaction) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1086
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OnTransactionAdded(TransactionAddedToMemoryPool transactionAddedToMempool) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 109
at Stratis.Bitcoin.EventBus.Subscription1.Publish(EventBase eventItem) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\EventBus\Subscription.cs:line 28 at Stratis.Bitcoin.EventBus.InMemoryEventBus.Publish[TEvent](TEvent event) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\EventBus\InMemoryEventBus.cs:line 104 at Stratis.Bitcoin.Features.MemoryPool.TxMempool.AddUnchecked(uint256 hash, TxMempoolEntry entry, SetEntries setAncestors, Boolean validFeeEstimate) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.MemoryPool\TxMemPool.cs:line 384 at Stratis.Bitcoin.Features.MemoryPool.MempoolValidator.<>c__DisplayClass34_0.<AcceptToMemoryPoolWorkerAsync>b__0() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.MemoryPool\MempoolValidator.cs:line 343 at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot) at System.Threading.Tasks.Task.ExecuteEntry() at System.Threading.Tasks.ConcurrentExclusiveSchedulerPair.ProcessExclusiveTasks() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot) at System.Threading.ThreadPoolWorkQueue.Dispatch().
--------------------------------------------------------------------------------------------------------------**
Then there's this:
[2020-03-18 01:53:55.5070 6] ERROR: Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync 'OrchestrateWalletSync' failed with: System.SystemException: Lock held by thread 29 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace()
at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82
at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.StartBatch(ProcessBlocksInfo round, ChainedHeader header) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 951
at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessBlocks(IEnumerable1 blocks, String walletName) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 790 at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1053
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.b19_0(CancellationToken token) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 94
at Stratis.Bitcoin.Utilities.AsyncLoop.<>cDisplayClass20_0.<b0>d.MoveNext() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\AsyncWork\AsyncLoop.cs:line 112
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.AsyncStateMachineBox1.MoveNext()
at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(IAsyncStateMachineBox box, Boolean allowInlining)
at System.Threading.Tasks.Task.RunContinuations(Object continuationObject)
at System.Threading.Tasks.Task1.TrySetResult(TResult result) at System.Threading.Tasks.Task.DelayPromise.Complete() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.TimerQueueTimer.CallCallback() at System.Threading.TimerQueueTimer.Fire() at System.Threading.TimerQueue.FireNextTimers().
at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1058 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182. [2020-03-18 01:53:56.5386 18] ERROR: Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync 'OrchestrateWalletSync' failed with: System.SystemException: Lock held by thread 29 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace() at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.StartBatch(ProcessBlocksInfo round, ChainedHeader header) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 951 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessBlocks(IEnumerable1 blocks, String walletName) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 790
at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func`2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1053
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.b19_0(CancellationToken token) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 94
at Stratis.Bitcoin.Utilities.AsyncLoop.<>cDisplayClass20_0.<b__0>d.MoveNext() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\AsyncWork\AsyncLoop.cs:line 112
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.AsyncStateMachineBox1.MoveNext()
at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(IAsyncStateMachineBox box, Boolean allowInlining)
at System.Threading.Tasks.Task.RunContinuations(Object continuationObject)
at System.Threading.Tasks.Task1.TrySetResult(TResult result) at System.Threading.Tasks.Task.DelayPromise.Complete() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.TimerQueueTimer.CallCallback() at System.Threading.TimerQueueTimer.Fire() at System.Threading.TimerQueue.FireNextTimers().
at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1058 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182. [2020-03-18 01:53:57.5698 18] ERROR: Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync 'OrchestrateWalletSync' failed with: System.SystemException: Lock held by thread 29 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace() at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.StartBatch(ProcessBlocksInfo round, ChainedHeader header) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 951 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessBlocks(IEnumerable1 blocks, String walletName) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 790
at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func`2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1053
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.b19_0(CancellationToken token) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 94
at Stratis.Bitcoin.Utilities.AsyncLoop.<>cDisplayClass20_0.<b__0>d.MoveNext() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\AsyncWork\AsyncLoop.cs:line 112
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.AsyncStateMachineBox1.MoveNext()
at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(IAsyncStateMachineBox box, Boolean allowInlining)
at System.Threading.Tasks.Task.RunContinuations(Object continuationObject)
at System.Threading.Tasks.Task1.TrySetResult(TResult result) at System.Threading.Tasks.Task.DelayPromise.Complete() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.TimerQueueTimer.CallCallback() at System.Threading.TimerQueueTimer.Fire() at System.Threading.TimerQueue.FireNextTimers().
at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1058 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182. [2020-03-18 01:53:58.5899 13] ERROR: Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync 'OrchestrateWalletSync' failed with: System.SystemException: Lock held by thread 29 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace() at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.StartBatch(ProcessBlocksInfo round, ChainedHeader header) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 951 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessBlocks(IEnumerable1 blocks, String walletName) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 790
at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func`2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1053
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.b19_0(CancellationToken token) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 94
at Stratis.Bitcoin.Utilities.AsyncLoop.<>cDisplayClass20_0.<b__0>d.MoveNext() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\AsyncWork\AsyncLoop.cs:line 112
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder1.AsyncStateMachineBox1.MoveNext()
at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(IAsyncStateMachineBox box, Boolean allowInlining)
at System.Threading.Tasks.Task.RunContinuations(Object continuationObject)
at System.Threading.Tasks.Task1.TrySetResult(TResult result) at System.Threading.Tasks.Task.DelayPromise.Complete() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.TimerQueueTimer.CallCallback() at System.Threading.TimerQueueTimer.Fire() at System.Threading.TimerQueue.FireNextTimers().
at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func`2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1058
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManag
er.cs:line 142
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182.
[2020-03-18 01:53:59.1581 5] INFO: Stratis.Bitcoin.FullNode.b77_1
Status show 99%. Block 1703111 out of 1703707. It does not syc pass this block.
I am running Windows Core v1.4.0. Yesterday night, staking was OK. Tonight, I do not see any staking info. Looking at the logs show:
**====== Async loops ====== [Running: 229] [Faulted: 1] Name Type Health
PartialValidator Dequeuer Faulted
1.Publish(EventBase eventItem) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\EventBus\Subscription.cs:line 28 at Stratis.Bitcoin.EventBus.InMemoryEventBus.Publish[TEvent](TEvent event) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\EventBus\InMemoryEventBus.cs:line 104 at Stratis.Bitcoin.Features.MemoryPool.TxMempool.AddUnchecked(uint256 hash, TxMempoolEntry entry, SetEntries setAncestors, Boolean validFeeEstimate) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.MemoryPool\TxMemPool.cs:line 384 at Stratis.Bitcoin.Features.MemoryPool.MempoolValidator.<>c__DisplayClass34_0.<AcceptToMemoryPoolWorkerAsync>b__0() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.MemoryPool\MempoolValidator.cs:line 343 at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot) at System.Threading.Tasks.Task.ExecuteEntry() at System.Threading.Tasks.ConcurrentExclusiveSchedulerPair.ProcessExclusiveTasks() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot) at System.Threading.ThreadPoolWorkQueue.Dispatch(). --------------------------------------------------------------------------------------------------------------**Then there's this:
[2020-03-18 01:53:55.5070 6] ERROR: Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync 'OrchestrateWalletSync' failed with: System.SystemException: Lock held by thread 29 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace() at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.StartBatch(ProcessBlocksInfo round, ChainedHeader header) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 951 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessBlocks(IEnumerableb19_0(CancellationToken token) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 94
at Stratis.Bitcoin.Utilities.AsyncLoop.<>cDisplayClass20_0.<b0>d.MoveNext() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\AsyncWork\AsyncLoop.cs:line 112
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilderb 19_0(CancellationToken token) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 94
at Stratis.Bitcoin.Utilities.AsyncLoop.<>cDisplayClass20_0.<b__0>d.MoveNext() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\AsyncWork\AsyncLoop.cs:line 112
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilderb 19_0(CancellationToken token) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 94
at Stratis.Bitcoin.Utilities.AsyncLoop.<>cDisplayClass20_0.<b__0>d.MoveNext() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\AsyncWork\AsyncLoop.cs:line 112
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilderb 19_0(CancellationToken token) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 94
at Stratis.Bitcoin.Utilities.AsyncLoop.<>cDisplayClass20_0.<b__0>d.MoveNext() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin\AsyncWork\AsyncLoop.cs:line 112
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Runtime.CompilerServices.AsyncTaskMethodBuilder
er.cs:line 142
at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182.
[2020-03-18 01:53:59.1581 5] INFO: Stratis.Bitcoin.FullNode.b 77_1
1 blocks, String walletName) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 790 at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1053 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.1.AsyncStateMachineBox1.MoveNext() at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(IAsyncStateMachineBox box, Boolean allowInlining) at System.Threading.Tasks.Task.RunContinuations(Object continuationObject) at System.Threading.Tasks.Task1.TrySetResult(TResult result) at System.Threading.Tasks.Task.DelayPromise.Complete() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.TimerQueueTimer.CallCallback() at System.Threading.TimerQueueTimer.Fire() at System.Threading.TimerQueue.FireNextTimers(). at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1058 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182. [2020-03-18 01:53:56.5386 18] ERROR: Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync 'OrchestrateWalletSync' failed with: System.SystemException: Lock held by thread 29 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace() at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.StartBatch(ProcessBlocksInfo round, ChainedHeader header) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 951 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessBlocks(IEnumerable1 blocks, String walletName) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 790 at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func`2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1053 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.1.AsyncStateMachineBox1.MoveNext() at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(IAsyncStateMachineBox box, Boolean allowInlining) at System.Threading.Tasks.Task.RunContinuations(Object continuationObject) at System.Threading.Tasks.Task1.TrySetResult(TResult result) at System.Threading.Tasks.Task.DelayPromise.Complete() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.TimerQueueTimer.CallCallback() at System.Threading.TimerQueueTimer.Fire() at System.Threading.TimerQueue.FireNextTimers(). at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1058 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182. [2020-03-18 01:53:57.5698 18] ERROR: Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync 'OrchestrateWalletSync' failed with: System.SystemException: Lock held by thread 29 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace() at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.StartBatch(ProcessBlocksInfo round, ChainedHeader header) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 951 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessBlocks(IEnumerable1 blocks, String walletName) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 790 at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func`2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1053 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.1.AsyncStateMachineBox1.MoveNext() at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(IAsyncStateMachineBox box, Boolean allowInlining) at System.Threading.Tasks.Task.RunContinuations(Object continuationObject) at System.Threading.Tasks.Task1.TrySetResult(TResult result) at System.Threading.Tasks.Task.DelayPromise.Complete() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.TimerQueueTimer.CallCallback() at System.Threading.TimerQueueTimer.Fire() at System.Threading.TimerQueue.FireNextTimers(). at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1058 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182. [2020-03-18 01:53:58.5899 13] ERROR: Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync 'OrchestrateWalletSync' failed with: System.SystemException: Lock held by thread 29 has not been released after 120 seconds as promised. The stack trace when the lock was taken is ' at System.Environment.get_StackTrace() at Stratis.Features.SQLiteWalletRepository.DBLock.Wait(Boolean wait, Int32 timeoutSeconds, String memberName, Int32 sourceLineNumber) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\DBLock.cs:line 82 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.StartBatch(ProcessBlocksInfo round, ChainedHeader header) in C:\Users\StratisTest\Desktop\DevOps\Agent2\_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 951 at Stratis.Features.SQLiteWalletRepository.SQLiteWalletRepository.ProcessBlocks(IEnumerable1 blocks, String walletName) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Features.SQLiteWalletRepository\SQLiteWalletRepository.cs:line 790 at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func`2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1053 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 142 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.OrchestrateWalletSync() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManager.cs:line 182 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.1.AsyncStateMachineBox1.MoveNext() at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(IAsyncStateMachineBox box, Boolean allowInlining) at System.Threading.Tasks.Task.RunContinuations(Object continuationObject) at System.Threading.Tasks.Task1.TrySetResult(TResult result) at System.Threading.Tasks.Task.DelayPromise.Complete() at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Threading.TimerQueueTimer.CallCallback() at System.Threading.TimerQueueTimer.Fire() at System.Threading.TimerQueue.FireNextTimers(). at Stratis.Bitcoin.Features.Wallet.WalletManager.ProcessBlocks(Func`2 blockProvider) in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletManager.cs:line 1058 at Stratis.Bitcoin.Features.Wallet.WalletSyncManager.ProcessBlocks() in C:\Users\StratisTest\Desktop\DevOps\Agent2_work\4\s\StratisBitcoinFullNode\src\Stratis.Bitcoin.Features.Wallet\WalletSyncManagStatus show 99%. Block 1703111 out of 1703707. It does not syc pass this block.