Azure / azure-functions-host

The host/runtime that powers Azure Functions
https://functions.azure.com
MIT License
1.94k stars 441 forks source link

Address flaky unit tests #10135

Open jviau opened 6 months ago

jviau commented 6 months ago

Using this issue to track flaky unit tests as they are discovered.

Flaky tests

Fix PR Test Failed Run
#10128 https://github.com/Azure/azure-functions-host/blob/1bf081347aa0ff3fa02e846802ae330611d192ff/test/WebJobs.Script.Tests/FileMonitoringServiceTests.cs#L286 N/A
TBD https://github.com/Azure/azure-functions-host/blob/1bf081347aa0ff3fa02e846802ae330611d192ff/test/WebJobs.Script.Tests/Security/SecretManagerTests.cs#L938 Failed run
#10145 https://github.com/Azure/azure-functions-host/blob/1bf081347aa0ff3fa02e846802ae330611d192ff/test/WebJobs.Script.Tests/Workers/Http/HttpFunctionInvocationDispatcherTests.cs#L23 Failed run
#10146 https://github.com/Azure/azure-functions-host/blob/1bf081347aa0ff3fa02e846802ae330611d192ff/test/WebJobs.Script.Tests/FunctionsSyncServiceTests.cs#L18
TBD https://github.com/Azure/azure-functions-host/blob/1bf081347aa0ff3fa02e846802ae330611d192ff/test/WebJobs.Script.Tests.Integration/WebHostEndToEnd/WebJobsStartupEndToEndTests.cs
TBD https://github.com/Azure/azure-functions-host/blob/d223fa7a6f5a0265c5ba105d278b1d74432bfa65/test/WebJobs.Script.Tests/StartupContextProviderTests.cs#L77 Failed run
TBD https://github.com/Azure/azure-functions-host/blob/633e2c05d31acadfa95bc347511fd8f7bfb1e312/test/WebJobs.Script.Tests/Workers/Rpc/GrpcWorkerChannelTests.cs#L251 Failed run
### Tasks
- [ ] https://github.com/Azure/azure-functions-host/pull/10145
- [ ] https://github.com/Azure/azure-functions-host/pull/10128
- [ ] https://github.com/Azure/azure-functions-host/pull/10146
- [ ] https://github.com/Azure/azure-functions-host/pull/10152
- [ ] https://github.com/Azure/azure-functions-host/pull/10172
kshyju commented 4 months ago

Few more from a recent build.

  1. Microsoft.Azure.WebJobs.Script.Tests.EndToEnd.NodeEndToEndTests.MultipleOutputs
  2. Microsoft.Azure.WebJobs.Script.Tests.NodeScriptHostTests.ExecutionContext_IsProvided
  3. Microsoft.Azure.WebJobs.Script.Tests.EndToEnd.SamplesEndToEndTests_Node_MultipleProcesses.NodeProcess_Different_AfterHostRestart
kshyju commented 3 months ago
  1. Microsoft.Azure.WebJobs.Script.Tests.Configuration.FunctionsHostingConfigOptionsTest.Case_Insensitive
  2. Microsoft.Azure.WebJobs.Script.Tests.Diagnostics.LinuxContainerEventGeneratorWithConsoleOutputTests.MultipleEventsBuffered
kshyju commented 3 months ago

Microsoft.Azure.WebJobs.Script.Tests.EndToEnd.SamplesEndToEndTests_Node_MultipleProcesses.NodeProcessCount_RemainsSame_AfterMultipleTimeouts