Parallel run fails with Error opening _Chutzpah

[nohwnd]

In https://github.com/microsoft/vstest repo we recently migrated to running tests in parallel and we are seeing issues with our chutzpah integration tests saying that:

"Error: Error opening C:/p/vstest/test/TestAssets/_Chutzpah.c4a6585ae69f811e39c559f59b2bcca71f588eea.test.html: 
No such file or directory
While Running:C:\\p\\vstest\\test\\TestAssets\\test.js

This only happens when tests run in parallel (multiple testhost processes at the same time, against a single js file).

I am guessing the issue is that:

• There are two processes running in parallel
• Process 1 creates _Chutzpah file
• Process 2 creates _Chutzpah file
• Process 1 grabs all _Chutzpah.* files and deletes them.
  https://github.com/mmanela/chutzpah/blob/f6278530d338852c73e0aa0f4db8146c7bfa073c/Chutzpah/FileProbe.cs#L83-L88 https://github.com/mmanela/chutzpah/blob/f6278530d338852c73e0aa0f4db8146c7bfa073c/Chutzpah/FileProbe.cs#L182-L188 https://github.com/mmanela/chutzpah/blob/8f898205fb1ebf22e4719254fd6b9ec63673ee3d/Chutzpah/TestContextBuilder.cs#L260-L274
• Process 2 throws because it cannot find the file.

I can easily solve this by copying that js file into temp folder, and everything works reliably. But I am wondering if there is a simple way to fix this on your side? And if you would be interested in fixing this?

Thanks! 🙂

[mmanela]

Thanks for reaching out @nohwnd. Chutzpah was not designed to support this scenario. It can handle parallelism on its own but it is assuming a given test context is only being executed by one process.

That said, it should be simple to expose a setting to suppress the clean up. (This is already done if you chose to open the tests in the browser or run in debugger).

[nohwnd]

Okay, thanks for confirmation. I don't think there is any action needed on your or my side. We have our workaround. :)