search

microsoft / durabletask-mssql

Microsoft SQL storage provider for Durable Functions and the Durable Task Framework
MIT License
87 stars 32 forks source link

Azure Durable Isolated Function - PurgeAllInstancesAsync #224

Open CGSK opened 4 months ago

CGSK commented 4 months ago

Calling DurableTaskClient.PurgeAllInstancesAsync throws Grpc.Core.RpcException.

We wanted to have a seamless purge all experience between Azure Storage & SQL Durable Providers.

We do not want to use DurableTaskClient.Purgexxx for AzureStorage & write a SQL store proc call (PurgeInstanceStateByTime) for SQL provider.

LOGS: [2024-05-30T21:05:52.187Z] Function 'PurgeDurableFunctionsHistory', Invocation id '181eb69c-f632-426d-9a7e-cef38b335400': An exception was thrown by the invocation. [2024-05-30T21:05:52.189Z] Result: Function 'PurgeDurableFunctionsHistory', Invocation id '181eb69c-f632-426d-9a7e-cef38b335400': An exception was thrown by the invocation. Exception: Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.") [2024-05-30T21:05:52.190Z] at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-30T21:05:52.194Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-30T21:05:52.196Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-30T21:05:52.197Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-30T21:05:52.198Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 Stack: at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-30T21:05:52.199Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-30T21:05:52.200Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-30T21:05:52.201Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-30T21:05:52.202Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89. [2024-05-30T21:05:52.227Z] Executed 'Functions.PurgeDurableFunctionsHistory' (Failed, Id=181eb69c-f632-426d-9a7e-cef38b335400, Duration=238ms) [2024-05-30T21:05:52.229Z] System.Private.CoreLib: Exception while executing function: Functions.PurgeDurableFunctionsHistory. System.Private.CoreLib: Result: Failure Exception: Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.") [2024-05-30T21:05:52.229Z] at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-30T21:05:52.230Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-30T21:05:52.231Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-30T21:05:52.232Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-30T21:05:52.233Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 [2024-05-30T21:05:52.234Z] at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88 Stack: at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-30T21:05:52.235Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-30T21:05:52.240Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-30T21:05:52.242Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-30T21:05:52.243Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 [2024-05-30T21:05:52.245Z] at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88.

cgillum commented 4 months ago

The exception you're seeing simply says there was an error, but not what the error was. Are you able to see more failure information from the Azure Functions host logs, which is where the underlying error would be occurring?

CGSK commented 4 months ago

@cgillum The exception happening in my local where I do not have much log other that what I posted in my previous message.

image

Is sql provider purging supported through Isolated function?

cgillum commented 4 months ago

@CGSK if you're running local, do you not see any errors in the console window that pops up when you're debugging your .NET Isolated function app?

CGSK commented 4 months ago

That's all the error I am getting. Added all the logs from the console.

Is sql provider purging supported through Isolated function?

Azure Functions Core Tools Core Tools Version: 4.0.5801 Commit hash: N/A +5ac2f09758b98257e728dd1b5576ce5ea9ef68ff (64-bit) Function Runtime Version: 4.34.1.22669

[2024-05-31T18:28:48.709Z] Found C:\code\FirstIsoFuncApp\FirstIsoFuncApp.csproj. Using for user secrets file configuration. [2024-05-31T18:28:49.217Z] Building host: version spec: , startup suppressed: 'False', configuration suppressed: 'False', startup operation id: 'a9393328-88ca-4ae7-8d05-7b4a48a30d51' [2024-05-31T18:28:49.225Z] Reading host configuration file 'C:\code\FirstIsoFuncApp\bin\Debug\net8.0\host.json' [2024-05-31T18:28:49.226Z] Host configuration file read: [2024-05-31T18:28:49.226Z] { [2024-05-31T18:28:49.227Z] "version": "2.0", [2024-05-31T18:28:49.227Z] "logging": { [2024-05-31T18:28:49.227Z] "logLevel": { [2024-05-31T18:28:49.228Z] "default": "Information" [2024-05-31T18:28:49.228Z] }, [2024-05-31T18:28:49.229Z] "applicationInsights": { [2024-05-31T18:28:49.229Z] "samplingSettings": { [2024-05-31T18:28:49.230Z] "isEnabled": true, [2024-05-31T18:28:49.231Z] "excludedTypes": "Request" [2024-05-31T18:28:49.231Z] }, [2024-05-31T18:28:49.232Z] "enableLiveMetricsFilters": true [2024-05-31T18:28:49.232Z] } [2024-05-31T18:28:49.233Z] }, [2024-05-31T18:28:49.233Z] "extensions": { [2024-05-31T18:28:49.233Z] "durableTask": { [2024-05-31T18:28:49.234Z] "hubName": "dt", [2024-05-31T18:28:49.234Z] "storageProvider": { [2024-05-31T18:28:49.234Z] "type": "mssql", [2024-05-31T18:28:49.235Z] "connectionStringName": "DurableSQLStoreConnectionString", [2024-05-31T18:28:49.236Z] "taskEventLockTimeout": "00:02:00", [2024-05-31T18:28:49.236Z] "createDatabaseIfNotExists": true, [2024-05-31T18:28:49.237Z] "schemaName": "dt" [2024-05-31T18:28:49.237Z] } [2024-05-31T18:28:49.238Z] }, [2024-05-31T18:28:49.239Z] "serviceBus": { [2024-05-31T18:28:49.239Z] "maxConcurrentCalls": 32, [2024-05-31T18:28:49.240Z] "maxAutoLockRenewalDuration": "2.00:00:00" [2024-05-31T18:28:49.241Z] } [2024-05-31T18:28:49.241Z] } [2024-05-31T18:28:49.242Z] } [2024-05-31T18:28:49.257Z] Extension Bundle not loaded. Loading extensions from C:\code\FirstIsoFuncApp\bin\Debug\net8.0. BundleConfigured: False, PrecompiledFunctionApp: False, LegacyBundle: False, DotnetIsolatedApp: True, isLogicApp: False [2024-05-31T18:28:49.258Z] Script Startup resetting load context with base path: 'C:\code\FirstIsoFuncApp\bin\Debug\net8.0.azurefunctions'. [2024-05-31T18:28:49.268Z] Loading startup extension 'SqlDurabilityProvider' [2024-05-31T18:28:49.315Z] Loaded extension 'SqlDurabilityProvider' (1.2.0.0) [2024-05-31T18:28:49.325Z] Loading startup extension 'DurableTask' [2024-05-31T18:28:49.330Z] Loaded extension 'DurableTask' (2.0.0.0) [2024-05-31T18:28:49.331Z] Loading startup extension 'Startup' [2024-05-31T18:28:49.333Z] Loaded extension 'Startup' (1.0.0.0) [2024-05-31T18:28:49.351Z] Reading host configuration file 'C:\code\FirstIsoFuncApp\bin\Debug\net8.0\host.json' [2024-05-31T18:28:49.352Z] Host configuration file read: [2024-05-31T18:28:49.353Z] { [2024-05-31T18:28:49.353Z] "version": "2.0", [2024-05-31T18:28:49.355Z] "logging": { [2024-05-31T18:28:49.356Z] "logLevel": { [2024-05-31T18:28:49.356Z] "default": "Information" [2024-05-31T18:28:49.357Z] }, [2024-05-31T18:28:49.357Z] "applicationInsights": { [2024-05-31T18:28:49.358Z] "samplingSettings": { [2024-05-31T18:28:49.359Z] "isEnabled": true, [2024-05-31T18:28:49.359Z] "excludedTypes": "Request" [2024-05-31T18:28:49.360Z] }, [2024-05-31T18:28:49.361Z] "enableLiveMetricsFilters": true [2024-05-31T18:28:49.361Z] } [2024-05-31T18:28:49.362Z] }, [2024-05-31T18:28:49.362Z] "extensions": { [2024-05-31T18:28:49.363Z] "durableTask": { [2024-05-31T18:28:49.363Z] "hubName": "dt", [2024-05-31T18:28:49.364Z] "storageProvider": { [2024-05-31T18:28:49.364Z] "type": "mssql", [2024-05-31T18:28:49.365Z] "connectionStringName": "DurableSQLStoreConnectionString", [2024-05-31T18:28:49.365Z] "taskEventLockTimeout": "00:02:00", [2024-05-31T18:28:49.366Z] "createDatabaseIfNotExists": true, [2024-05-31T18:28:49.366Z] "schemaName": "dt" [2024-05-31T18:28:49.367Z] } [2024-05-31T18:28:49.368Z] }, [2024-05-31T18:28:49.368Z] "serviceBus": { [2024-05-31T18:28:49.369Z] "maxConcurrentCalls": 32, [2024-05-31T18:28:49.369Z] "maxAutoLockRenewalDuration": "2.00:00:00" [2024-05-31T18:28:49.372Z] } [2024-05-31T18:28:49.372Z] } [2024-05-31T18:28:49.373Z] } [2024-05-31T18:28:49.777Z] Using the mssql storage provider. [2024-05-31T18:28:50.309Z] Initializing Warmup Extension. [2024-05-31T18:28:50.320Z] Resolved secret storage provider BlobStorageSecretsRepository [2024-05-31T18:28:50.462Z] Durable extension configuration loaded: {"httpSettings":{"defaultAsyncRequestSleepTimeMilliseconds":30000},"hubName":"dt","storageProvider":{"connectionStringName":"DurableSQLStoreConnectionString","taskHubName":"dt","taskEventLockTimeout":"00:02:00","taskEventBatchSize":10,"createDatabaseIfNotExists":true,"schemaName":"dt"},"tracing":{"traceInputsAndOutputs":false,"allowVerboseLinuxTelemetry":false,"traceReplayEvents":false,"distributedTracingEnabled":false,"distributedTracingProtocol":"HttpCorrelationProtocol","version":"V1"},"notifications":{"eventGrid":null},"maxConcurrentActivityFunctions":null,"maxConcurrentOrchestratorFunctions":null,"maxConcurrentEntityFunctions":null,"localRpcEndpointEnabled":null,"maxEntityOperationBatchSize":null,"extendedSessionsEnabled":false,"extendedSessionIdleTimeoutInSeconds":30,"maxOrchestrationActions":100000,"overridableExistingInstanceStates":"NonRunningStates","entityMessageReorderWindowInMinutes":30,"useGracefulShutdown":false,"rollbackEntityOperationsOnExceptions":true,"throwStatusExceptionsOnRaiseEvent":null,"useAppLease":true,"storeInputsInOrchestrationHistory":false,"appLeaseOptions":{"renewInterval":"00:00:25","acquireInterval":"00:05:00","leaseInterval":"00:01:00"}}. HubName: dt. AppName: . SlotName: . ExtensionVersion: 2.13.2. [2024-05-31T18:28:50.594Z] Opened local gRPC endpoint: http://localhost:4001. InstanceId: . Function: . HubName: dt. AppName: . SlotName: . ExtensionVersion: 2.13.2. SequenceNumber: 0. [2024-05-31T18:28:50.640Z] Initializing Host. OperationId: 'a9393328-88ca-4ae7-8d05-7b4a48a30d51'. [2024-05-31T18:28:50.651Z] Host initialization: ConsecutiveErrors=0, StartupCount=1, OperationId=a9393328-88ca-4ae7-8d05-7b4a48a30d51 [2024-05-31T18:28:50.708Z] Loading functions metadata [2024-05-31T18:28:50.710Z] Worker indexing is enabled [2024-05-31T18:28:50.716Z] Fetching metadata for workerRuntime: dotnet-isolated [2024-05-31T18:28:50.717Z] Reading functions metadata (Worker) [2024-05-31T18:28:53.599Z] { [2024-05-31T18:28:53.600Z] "ProcessId": 62104, [2024-05-31T18:28:53.601Z] "RuntimeIdentifier": "win-x64", [2024-05-31T18:28:53.602Z] "WorkerVersion": "1.18.0.0", [2024-05-31T18:28:53.603Z] "ProductVersion": "1.18.0\u002B1e81e6133d75399dc71a808ae9d06db8f4566d99", [2024-05-31T18:28:53.604Z] "FrameworkDescription": ".NET 8.0.5", [2024-05-31T18:28:53.605Z] "OSDescription": "Microsoft Windows 10.0.19045", [2024-05-31T18:28:53.606Z] "OSArchitecture": "X64", [2024-05-31T18:28:53.607Z] "CommandLine": "C:\code\FirstIsoFuncApp\bin\Debug\net8.0\FirstIsoFuncApp.dll --host 127.0.0.1 --port 59459 --workerId 8023e7a1-9aac-4cca-bf93-94dc4a08bce3 --requestId 83286fda-c4f4-46e4-b1aa-17a3df055a5e --grpcMaxMessageLength 2147483647 --functions-uri http://127.0.0.1:59459/ --functions-worker-id 8023e7a1-9aac-4cca-bf93-94dc4a08bce3 --functions-request-id 83286fda-c4f4-46e4-b1aa-17a3df055a5e --functions-grpc-max-message-length 2147483647" [2024-05-31T18:28:53.608Z] } [2024-05-31T18:28:53.718Z] 4 functions found (Worker) [2024-05-31T18:28:53.732Z] Reading functions metadata (Custom) [2024-05-31T18:28:53.743Z] 1 functions found (Custom) [2024-05-31T18:28:53.751Z] 4 functions loaded [2024-05-31T18:28:53.754Z] Azure Functions .NET Worker (PID: 62104) initialized in debug mode. Waiting for debugger to attach... [2024-05-31T18:28:53.758Z] LoggerFilterOptions [2024-05-31T18:28:53.759Z] { [2024-05-31T18:28:53.760Z] "MinLevel": "None", [2024-05-31T18:28:53.761Z] "Rules": [ [2024-05-31T18:28:53.762Z] { [2024-05-31T18:28:53.762Z] "ProviderName": null, [2024-05-31T18:28:53.763Z] "CategoryName": null, [2024-05-31T18:28:53.764Z] "LogLevel": null, [2024-05-31T18:28:53.764Z] "Filter": "b0" [2024-05-31T18:28:53.765Z] }, [2024-05-31T18:28:53.765Z] { [2024-05-31T18:28:53.766Z] "ProviderName": null, [2024-05-31T18:28:53.767Z] "CategoryName": null, [2024-05-31T18:28:53.767Z] "LogLevel": "Information", [2024-05-31T18:28:53.768Z] "Filter": null [2024-05-31T18:28:53.768Z] }, [2024-05-31T18:28:53.769Z] { [2024-05-31T18:28:53.769Z] "ProviderName": "Microsoft.Azure.WebJobs.Script.WebHost.Diagnostics.SystemLoggerProvider", [2024-05-31T18:28:53.770Z] "CategoryName": null, [2024-05-31T18:28:53.771Z] "LogLevel": "None", [2024-05-31T18:28:53.772Z] "Filter": null [2024-05-31T18:28:53.772Z] }, [2024-05-31T18:28:53.775Z] { [2024-05-31T18:28:53.775Z] "ProviderName": "Microsoft.Azure.WebJobs.Script.WebHost.Diagnostics.SystemLoggerProvider", [2024-05-31T18:28:53.776Z] "CategoryName": null, [2024-05-31T18:28:53.777Z] "LogLevel": null, [2024-05-31T18:28:53.777Z] "Filter": "b0" [2024-05-31T18:28:53.778Z] }, [2024-05-31T18:28:53.778Z] { [2024-05-31T18:28:53.779Z] "ProviderName": "Azure.Functions.Cli.Diagnostics.ColoredConsoleLoggerProvider", [2024-05-31T18:28:53.780Z] "CategoryName": null, [2024-05-31T18:28:53.780Z] "LogLevel": null, [2024-05-31T18:28:53.781Z] "Filter": "b0" [2024-05-31T18:28:53.782Z] } [2024-05-31T18:28:53.782Z] ] [2024-05-31T18:28:53.783Z] } [2024-05-31T18:28:53.784Z] LoggerFilterOptions [2024-05-31T18:28:53.784Z] { [2024-05-31T18:28:53.785Z] "MinLevel": "None", [2024-05-31T18:28:53.785Z] "Rules": [ [2024-05-31T18:28:53.786Z] { [2024-05-31T18:28:53.786Z] "ProviderName": null, [2024-05-31T18:28:53.787Z] "CategoryName": null, [2024-05-31T18:28:53.788Z] "LogLevel": null, [2024-05-31T18:28:53.788Z] "Filter": "b0" [2024-05-31T18:28:53.791Z] }, [2024-05-31T18:28:53.793Z] { [2024-05-31T18:28:53.794Z] "ProviderName": null, [2024-05-31T18:28:53.795Z] "CategoryName": null, [2024-05-31T18:28:53.795Z] "LogLevel": "Information", [2024-05-31T18:28:53.796Z] "Filter": null [2024-05-31T18:28:53.797Z] }, [2024-05-31T18:28:53.797Z] { [2024-05-31T18:28:53.798Z] "ProviderName": "Microsoft.Azure.WebJobs.Script.WebHost.Diagnostics.SystemLoggerProvider", [2024-05-31T18:28:53.799Z] "CategoryName": null, [2024-05-31T18:28:53.799Z] "LogLevel": "None", [2024-05-31T18:28:53.800Z] "Filter": null [2024-05-31T18:28:53.800Z] }, [2024-05-31T18:28:53.801Z] { [2024-05-31T18:28:53.801Z] "ProviderName": "Microsoft.Azure.WebJobs.Script.WebHost.Diagnostics.SystemLoggerProvider", [2024-05-31T18:28:53.802Z] "CategoryName": null, [2024-05-31T18:28:53.803Z] "LogLevel": null, [2024-05-31T18:28:53.803Z] "Filter": "b0" [2024-05-31T18:28:53.806Z] }, [2024-05-31T18:28:53.807Z] { [2024-05-31T18:28:53.808Z] "ProviderName": "Azure.Functions.Cli.Diagnostics.ColoredConsoleLoggerProvider", [2024-05-31T18:28:53.809Z] "CategoryName": null, [2024-05-31T18:28:53.811Z] "LogLevel": null, [2024-05-31T18:28:53.811Z] "Filter": "b0" [2024-05-31T18:28:53.812Z] } [2024-05-31T18:28:53.812Z] ] [2024-05-31T18:28:53.813Z] } [2024-05-31T18:28:53.814Z] LanguageWorkerOptions [2024-05-31T18:28:53.814Z] { [2024-05-31T18:28:53.815Z] "WorkerConfigs": [ [2024-05-31T18:28:53.818Z] { [2024-05-31T18:28:53.818Z] "Description": { [2024-05-31T18:28:53.819Z] "Language": "dotnet-isolated", [2024-05-31T18:28:53.819Z] "DefaultRuntimeName": null, [2024-05-31T18:28:53.821Z] "DefaultRuntimeVersion": null, [2024-05-31T18:28:53.823Z] "SupportedArchitectures": null, [2024-05-31T18:28:53.823Z] "SupportedOperatingSystems": null, [2024-05-31T18:28:53.824Z] "SupportedRuntimeVersions": null, [2024-05-31T18:28:53.825Z] "SanitizeRuntimeVersionRegex": null, [2024-05-31T18:28:53.826Z] "WorkerIndexing": "true", [2024-05-31T18:28:53.827Z] "Extensions": [ [2024-05-31T18:28:53.827Z] ".dll" [2024-05-31T18:28:53.828Z] ], [2024-05-31T18:28:53.829Z] "UseStdErrorStreamForErrorsOnly": false, [2024-05-31T18:28:53.830Z] "DefaultExecutablePath": "C:\Program Files\dotnet\dotnet.exe", [2024-05-31T18:28:53.831Z] "DefaultWorkerPath": "C:\code\FirstIsoFuncApp\bin\Debug\net8.0\FirstIsoFuncApp.dll", [2024-05-31T18:28:53.833Z] "WorkerDirectory": "C:\code\FirstIsoFuncApp\bin\Debug\net8.0", [2024-05-31T18:28:53.833Z] "Arguments": [], [2024-05-31T18:28:53.834Z] "WorkerArguments": null [2024-05-31T18:28:53.835Z] }, [2024-05-31T18:28:53.837Z] "Arguments": { [2024-05-31T18:28:53.838Z] "ExecutablePath": "C:\Program Files\dotnet\dotnet.exe", [2024-05-31T18:28:53.839Z] "ExecutableArguments": [], [2024-05-31T18:28:53.839Z] "WorkerPath": "C:\code\FirstIsoFuncApp\bin\Debug\net8.0\FirstIsoFuncApp.dll", [2024-05-31T18:28:53.840Z] "WorkerArguments": [] [2024-05-31T18:28:53.840Z] }, [2024-05-31T18:28:53.842Z] "CountOptions": { [2024-05-31T18:28:53.843Z] "SetProcessCountToNumberOfCpuCores": false, [2024-05-31T18:28:53.844Z] "ProcessCount": 1, [2024-05-31T18:28:53.844Z] "MaxProcessCount": 10, [2024-05-31T18:28:53.845Z] "ProcessStartupInterval": "00:00:10", [2024-05-31T18:28:53.846Z] "ProcessStartupTimeout": "30.00:00:00", [2024-05-31T18:28:53.847Z] "InitializationTimeout": "30.00:00:00", [2024-05-31T18:28:53.848Z] "EnvironmentReloadTimeout": "00:00:30", [2024-05-31T18:28:53.849Z] "ProcessRestartInterval": "00:00:10", [2024-05-31T18:28:53.849Z] "ProcessShutdownTimeout": "00:00:10" [2024-05-31T18:28:53.851Z] } [2024-05-31T18:28:53.853Z] } [2024-05-31T18:28:53.854Z] ] [2024-05-31T18:28:53.854Z] } [2024-05-31T18:28:53.855Z] ConcurrencyOptions [2024-05-31T18:28:53.856Z] { [2024-05-31T18:28:53.857Z] "DynamicConcurrencyEnabled": false, [2024-05-31T18:28:53.858Z] "MaximumFunctionConcurrency": 500, [2024-05-31T18:28:53.859Z] "CPUThreshold": 0.8, [2024-05-31T18:28:53.859Z] "SnapshotPersistenceEnabled": true [2024-05-31T18:28:53.860Z] } [2024-05-31T18:28:53.861Z] FunctionResultAggregatorOptions [2024-05-31T18:28:53.862Z] { [2024-05-31T18:28:53.863Z] "BatchSize": 1000, [2024-05-31T18:28:53.863Z] "FlushTimeout": "00:00:30", [2024-05-31T18:28:53.864Z] "IsEnabled": true [2024-05-31T18:28:53.865Z] } [2024-05-31T18:28:53.866Z] SingletonOptions [2024-05-31T18:28:53.866Z] { [2024-05-31T18:28:53.867Z] "LockPeriod": "00:00:15", [2024-05-31T18:28:53.870Z] "ListenerLockPeriod": "00:00:15", [2024-05-31T18:28:53.871Z] "LockAcquisitionTimeout": "10675199.02:48:05.4775807", [2024-05-31T18:28:53.872Z] "LockAcquisitionPollingInterval": "00:00:05", [2024-05-31T18:28:53.872Z] "ListenerLockRecoveryPollingInterval": "00:01:00" [2024-05-31T18:28:53.873Z] } [2024-05-31T18:28:53.874Z] ScaleOptions [2024-05-31T18:28:53.875Z] { [2024-05-31T18:28:53.875Z] "ScaleMetricsMaxAge": "00:02:00", [2024-05-31T18:28:53.876Z] "ScaleMetricsSampleInterval": "00:00:10", [2024-05-31T18:28:53.877Z] "MetricsPurgeEnabled": true, [2024-05-31T18:28:53.878Z] "IsTargetScalingEnabled": true, [2024-05-31T18:28:53.879Z] "IsRuntimeScalingEnabled": false [2024-05-31T18:28:53.879Z] } [2024-05-31T18:28:53.881Z] Starting JobHost [2024-05-31T18:28:53.884Z] Starting Host (HostId=us1238136w2-1609223344, InstanceId=54232736-dcde-4ca0-a44c-c10ebdb8c3cb, Version=4.34.1.22669, ProcessId=39772, AppDomainId=1, InDebugMode=False, InDiagnosticMode=False, FunctionsExtensionVersion=(null)) [2024-05-31T18:28:53.941Z] Generating 4 job function(s) [2024-05-31T18:28:53.942Z] Worker process started and initialized. [2024-05-31T18:28:54.004Z] Found the following functions: [2024-05-31T18:28:54.006Z] Host.Functions.ActivityWrappedObjectInput [2024-05-31T18:28:54.007Z] Host.Functions.OrchMain [2024-05-31T18:28:54.009Z] Host.Functions.PurgeDurableFunctionsHistory [2024-05-31T18:28:54.013Z] Host.Functions.PurgeInstanceEntity [2024-05-31T18:28:54.014Z] [2024-05-31T18:28:54.028Z] HttpOptions [2024-05-31T18:28:54.029Z] { [2024-05-31T18:28:54.031Z] "DynamicThrottlesEnabled": false, [2024-05-31T18:28:54.032Z] "EnableChunkedRequestBinding": false, [2024-05-31T18:28:54.033Z] "MaxConcurrentRequests": -1, [2024-05-31T18:28:54.033Z] "MaxOutstandingRequests": -1, [2024-05-31T18:28:54.030Z] Initializing function HTTP routes [2024-05-31T18:28:54.035Z] "RoutePrefix": "api" [2024-05-31T18:28:54.037Z] } [2024-05-31T18:28:54.036Z] No HTTP routes mapped [2024-05-31T18:28:54.040Z] [2024-05-31T18:28:54.049Z] Host initialized (154ms) [2024-05-31T18:28:54.053Z] Starting task hub worker. Extension GUID b2146b14-5a81-4ce6-87d5-f8deb68d998b. InstanceId: . Function: . HubName: dt. AppName: . SlotName: . ExtensionVersion: 2.13.2. SequenceNumber: 1.

Functions:

    ActivityWrappedObjectInput: activityTrigger

    OrchMain: orchestrationTrigger

    PurgeDurableFunctionsHistory: timerTrigger

    PurgeInstanceEntity: entityTrigger

For detailed output, run func with --verbose flag. [2024-05-31T18:28:54.468Z] Acquired app lock after 12ms (status code = 0) [2024-05-31T18:28:54.485Z] Durable task hub worker is starting [2024-05-31T18:28:54.506Z] Durable task hub worker started successfully after 18ms [2024-05-31T18:28:54.508Z] Task hub worker started. Latency: 00:00:00.4513688. Extension GUID b2146b14-5a81-4ce6-87d5-f8deb68d998b. InstanceId: . Function: . HubName: dt. AppName: . SlotName: . ExtensionVersion: 2.13.2. SequenceNumber: 2. [2024-05-31T18:28:54.513Z] Host started (626ms) [2024-05-31T18:28:54.516Z] Job host started [2024-05-31T18:28:54.535Z] No events were found. Waiting for new events to appear. [2024-05-31T18:28:58.780Z] Host lock lease acquired by instance ID '000000000000000000000000EC009A34'. [2024-05-31T18:29:25.313Z] No events were found. Waiting for new events to appear. [2024-05-31T18:29:54.205Z] The next 5 occurrences of the 'PurgeDurableFunctionsHistory' schedule (Cron: '5 *') will be: [2024-05-31T18:29:54.208Z] 05/31/2024 14:30:05-04:00 (05/31/2024 18:30:05Z) [2024-05-31T18:29:54.209Z] 05/31/2024 14:31:05-04:00 (05/31/2024 18:31:05Z) [2024-05-31T18:29:54.209Z] 05/31/2024 14:32:05-04:00 (05/31/2024 18:32:05Z) [2024-05-31T18:29:54.210Z] 05/31/2024 14:33:05-04:00 (05/31/2024 18:33:05Z) [2024-05-31T18:29:54.211Z] 05/31/2024 14:34:05-04:00 (05/31/2024 18:34:05Z) [2024-05-31T18:29:54.211Z] [2024-05-31T18:29:54.252Z] Executing 'Functions.PurgeDurableFunctionsHistory' (Reason='Timer fired at 2024-05-31T14:29:54.2289243-04:00', Id=7e5bb865-f59c-4ac0-9c88-5c955d7843f7) [2024-05-31T18:29:54.255Z] Trigger Details: UnscheduledInvocationReason: IsPastDue, OriginalSchedule: 2024-05-31T14:18:05.0000000-04:00 [2024-05-31T18:29:54.400Z] 'PurgeDurableFunctionsHistory' Timer trigger function begins execution at: 5/31/2024 2:29:54 PM [2024-05-31T18:29:54.406Z] Purging instances with filter: { CreatedFrom = (null), CreatedTo = , Statuses = } [2024-05-31T18:29:54.497Z] 'PurgeDurableFunctionsHistory' Timer trigger function ends execution at: 5/31/2024 2:29:54 PM [2024-05-31T18:29:54.547Z] Function 'PurgeDurableFunctionsHistory', Invocation id '7e5bb865-f59c-4ac0-9c88-5c955d7843f7': An exception was thrown by the invocation. [2024-05-31T18:29:54.548Z] Result: Function 'PurgeDurableFunctionsHistory', Invocation id '7e5bb865-f59c-4ac0-9c88-5c955d7843f7': An exception was thrown by the invocation. Exception: Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.") [2024-05-31T18:29:54.550Z] at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-31T18:29:54.553Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-31T18:29:54.554Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-31T18:29:54.556Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-31T18:29:54.557Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 Stack: at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-31T18:29:54.558Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-31T18:29:54.559Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-31T18:29:54.560Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-31T18:29:54.561Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89. [2024-05-31T18:29:54.590Z] Executed 'Functions.PurgeDurableFunctionsHistory' (Failed, Id=7e5bb865-f59c-4ac0-9c88-5c955d7843f7, Duration=353ms) [2024-05-31T18:29:54.592Z] System.Private.CoreLib: Exception while executing function: Functions.PurgeDurableFunctionsHistory. System.Private.CoreLib: Result: Failure Exception: Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.") [2024-05-31T18:29:54.593Z] at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-31T18:29:54.594Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-31T18:29:54.594Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-31T18:29:54.595Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-31T18:29:54.596Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 [2024-05-31T18:29:54.598Z] at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88 Stack: at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-31T18:29:54.601Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-31T18:29:54.602Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-31T18:29:54.603Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-31T18:29:54.603Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 [2024-05-31T18:29:54.604Z] at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88. [2024-05-31T18:29:55.439Z] No events were found. Waiting for new events to appear. [2024-05-31T18:30:05.012Z] Executing 'Functions.PurgeDurableFunctionsHistory' (Reason='Timer fired at 2024-05-31T14:30:05.0125411-04:00', Id=a350d078-72dc-47d1-9a42-631fdb0a2d28) [2024-05-31T18:30:05.018Z] 'PurgeDurableFunctionsHistory' Timer trigger function begins execution at: 5/31/2024 2:30:05 PM [2024-05-31T18:30:05.018Z] Purging instances with filter: { CreatedFrom = (null), CreatedTo = , Statuses = } [2024-05-31T18:30:05.037Z] 'PurgeDurableFunctionsHistory' Timer trigger function ends execution at: 5/31/2024 2:30:05 PM [2024-05-31T18:30:05.052Z] Function 'PurgeDurableFunctionsHistory', Invocation id 'a350d078-72dc-47d1-9a42-631fdb0a2d28': An exception was thrown by the invocation. [2024-05-31T18:30:05.053Z] Result: Function 'PurgeDurableFunctionsHistory', Invocation id 'a350d078-72dc-47d1-9a42-631fdb0a2d28': An exception was thrown by the invocation. Exception: Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.") [2024-05-31T18:30:05.055Z] at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-31T18:30:05.070Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-31T18:30:05.071Z] Executed 'Functions.PurgeDurableFunctionsHistory' (Failed, Id=a350d078-72dc-47d1-9a42-631fdb0a2d28, Duration=57ms) [2024-05-31T18:30:05.072Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-31T18:30:05.077Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-31T18:30:05.073Z] System.Private.CoreLib: Exception while executing function: Functions.PurgeDurableFunctionsHistory. System.Private.CoreLib: Result: Failure Exception: Grpc.Core.RpcException: Status(StatusCode="Unknown", Detail="Exception was thrown by handler.") [2024-05-31T18:30:05.081Z] at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-31T18:30:05.079Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 Stack: at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-31T18:30:05.082Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-31T18:30:05.085Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-31T18:30:05.088Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-31T18:30:05.093Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-31T18:30:05.087Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-31T18:30:05.094Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89. [2024-05-31T18:30:05.096Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-31T18:30:05.099Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 [2024-05-31T18:30:05.101Z] at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88 Stack: at Microsoft.DurableTask.Client.Grpc.GrpcDurableTaskClient.PurgeInstancesCoreAsync(PurgeInstancesRequest request, CancellationToken cancellation) [2024-05-31T18:30:05.103Z] at FirstIsoFuncApp.Function1.PurgeDurableFunctionsHistoryAsync(TimerInfo myTimer, DurableTaskClient client, CancellationToken cancellationToken) in C:\code\FirstIsoFuncApp\Function1.cs:line 122 [2024-05-31T18:30:05.105Z] at FirstIsoFuncApp.DirectFunctionExecutor.ExecuteAsync(FunctionContext context) in C:\code\FirstIsoFuncApp\obj\Debug\net8.0\Microsoft.Azure.Functions.Worker.Sdk.Generators\Microsoft.Azure.Functions.Worker.Sdk.Generators.FunctionExecutorGenerator\GeneratedFunctionExecutor.g.cs:line 51 [2024-05-31T18:30:05.111Z] at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13 [2024-05-31T18:30:05.114Z] at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89 [2024-05-31T18:30:05.115Z] at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88. [2024-05-31T18:30:25.568Z] No events were found. Waiting for new events to appear.

cgillum commented 4 months ago

Thanks. So, from the timestamps in these logs, it looks like the failure is instantaneous (and not related to timeouts)? I think we'll need to set up a local repro to confirm that there isn't a compatibility issue between the .NET Isolated worker and the MSSQL backend when it comes to purge.

CGSK commented 4 months ago

@cgillum FYI, I raised a timing out issue for PurgeAll when using .NET isolated worker with Azure Storage 308

We have a production use case using .NET Isolated Worker with Azure Storage on a few region and SQL on a few region

CGSK commented 4 months ago

@cgillum after further analysis, the reported exception (PurgeAllInstancesAsync) happens when using the below nuget version

<PackageReference Include="Microsoft.Azure.Functions.Worker.Extensions.DurableTask" Version="1.1.2" />
<PackageReference Include="Microsoft.Azure.Functions.Worker.Extensions.DurableTask.SqlServer" Version="1.2.3" />

The latest works fine

<PackageReference Include="Microsoft.Azure.Functions.Worker.Extensions.DurableTask" Version="1.1.4" />
<PackageReference Include="Microsoft.Azure.Functions.Worker.Extensions.DurableTask.SqlServer" Version="1.3.0" />