search

dotnet / orleans

Cloud Native application framework for .NET
https://docs.microsoft.com/dotnet/orleans
MIT License
10.04k stars 2.02k forks source link

Reminder problem #112

Closed witterlee closed 9 years ago

witterlee commented 9 years ago

this.RegisterOrUpdateReminder("keepAlive", TimeSpan.FromMinutes(1), TimeSpan.FromMinutes(1));

Task IRemindable.ReceiveReminder(string reminderName, Orleans.Runtime.TickStatus status) { Console.WriteLine(DateTime.Now.ToShortTimeString() + "-->I'm alive."); return TaskDone.Done; }

after three or four or at most five time reminder,then show a warning log, and the reminder do not work again.

the log is 

[2015-02-11 16:07:22.261 GMT    24  WARNING 101215  Scheduler.MembershipOracle.WorkItemGroup    127.0.0.1:11111]    Task [Id=1, Status=RanToCompletion] in WorkGroup [SystemTarget: S127.0.0.1:11111:161366830MembershipOracle@S0000000f] took elapsed time 0:00:00.2362834 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread.System/13, ManagedThreadId=24, Executing Task Id=1 Status=RanToCompletion for 00:00:00.2420138> 
[2015-02-11 16:07:25.441 GMT    24  WARNING 101215  Scheduler.ProviderManagerSystemTarget.WorkItemGroup 127.0.0.1:11111]    Task [Id=2, Status=RanToCompletion] in WorkGroup [SystemTarget: S127.0.0.1:11111:161366830ProviderManagerSystemTarget@S00000013] took elapsed time 0:00:02.2525229 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread.System/13, ManagedThreadId=24, Executing Task Id=2 Status=RanToCompletion for 00:00:02.2531289>  
[2015-02-11 16:07:27.178 GMT    13  WARNING 101215  Scheduler.WorkItemGroup 127.0.0.1:11111]    Task [Id=3, Status=RanToCompletion] in WorkGroup [Activation: S127.0.0.1:11111:161366830*grn/95499D40/00000000@fc2428aa #GrainType=Dotpay.Actors.Implementations.RippleToFinancialInstitutionListener State=Valid] took elapsed time 0:00:01.6784289 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread/2, ManagedThreadId=13, Executing Task Id=3 Status=RanToCompletion for 00:00:01.6800961>    
---------------------------------------------------------------------------------
<<<<<<<<<<<<<<<<<<four time console write line tell me alive>>>>>>>>>>>>>>>>>>>>>>
---------------------------------------------------------------------------------
[2015-02-11 16:11:49.086 GMT    18  WARNING 101215  Scheduler.DeploymentLoadPublisherSystemTarge.WorkItemGroup  127.0.0.1:11111]    Task [Id=4, Status=RanToCompletion] in WorkGroup [SystemTarget: S127.0.0.1:11111:161366830DeploymentLoadPublisherSystemTarge@S00000016] took elapsed time 0:00:00.6818602 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread/7, ManagedThreadId=18, Executing Task Id=4 Status=RanToCompletion for 00:00:00.6860392>   
[2015-02-11 16:11:51.521 GMT    18  WARNING 101215  Scheduler.DeploymentLoadPublisherSystemTarge.WorkItemGroup  127.0.0.1:11111]    Task [Id=5, Status=RanToCompletion] in WorkGroup [SystemTarget: S127.0.0.1:11111:161366830DeploymentLoadPublisherSystemTarge@S00000016] took elapsed time 0:00:00.7514032 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread/7, ManagedThreadId=18, Executing Task Id=5 Status=RanToCompletion for 00:00:00.7530431>   
[2015-02-11 16:11:51.521 GMT    19  WARNING 101215  Scheduler.Catalog.WorkItemGroup 127.0.0.1:11111]    Task [Id=6, Status=RanToCompletion] in WorkGroup [SystemTarget: S127.0.0.1:11111:161366830Catalog@S0000000e] took elapsed time 0:00:00.2396168 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread/8, ManagedThreadId=19, Executing Task Id=6 Status=RanToCompletion for 00:00:00.2400138>  
[2015-02-11 16:11:53.983 GMT    21  WARNING 101215  Scheduler.Catalog.WorkItemGroup 127.0.0.1:11111]    Task [Id=7, Status=RanToCompletion] in WorkGroup [SystemTarget: S127.0.0.1:11111:161366830Catalog@S0000000e] took elapsed time 0:00:00.2675875 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread/10, ManagedThreadId=21, Executing Task Id=7 Status=RanToCompletion for 00:00:00.2680154> 
[2015-02-11 16:11:54.637 GMT    23  WARNING 101215  Scheduler.DeploymentLoadPublisherSystemTarge.WorkItemGroup  127.0.0.1:11111]    Task [Id=9, Status=RanToCompletion] in WorkGroup [SystemTarget: S127.0.0.1:11111:161366830DeploymentLoadPublisherSystemTarge@S00000016] took elapsed time 0:00:00.9133736 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread/12, ManagedThreadId=23, Executing Task Id=9 Status=RanToCompletion for 00:00:00.9130522>  
[2015-02-11 16:11:54.637 GMT    16  WARNING 101215  Scheduler.WorkItemGroup 127.0.0.1:11111]    Task [Id=8, Status=RanToCompletion] in WorkGroup [Activation: S127.0.0.1:11111:161366830*grn/FCB3F509/00003039@88863891 #GrainType=Orleans.Runtime.ReminderService.GrainBasedReminderTable State=Valid] took elapsed time 0:00:00.7197611 for execution, which is longer than 00:00:00.2000000. Running on thread <Runtime.Scheduler.WorkerPoolThread/5, ManagedThreadId=16, Executing Task Id=8 Status=RanToCompletion for 00:00:00.7200412>
gabikliot commented 9 years ago

Looks like this might not be related to reminders, but maybe something else. GC pressure maybe. Lets take this off to the codeplex discussion page https://orleans.codeplex.com/discussions which we still use as a forum for questions and troubleshooting. We try tom keep the GH issues for code related question.

On codeplex, if you could attach your full silo log, this would help. Or send it to me directly (my email appears on my GH profile).