search

AnWeber / httpbook

Quickly and easily send REST, Soap, GraphQL, GRPC, MQTT and WebSocket requests directly within Visual Studio Code
https://httpyac.github.io/
MIT License
57 stars 4 forks source link

When using "Run all", is the order of execution of cells guaranteed? #105

Closed denisrossetre closed 7 months ago

denisrossetre commented 8 months ago

I'm using httpbook to automate API testing, and I saw in one instance that my tests are flaky when run with the "Run All" toolbar button.

Running them one cell after another works perfectly.

I cleared my history and reopened the request file to debug the order of calls, but now it works again.

My question: is the order of calls guaranteed when using Run All? is the runner waiting for the response of one cell before running the next one?

AnWeber commented 8 months ago

Actually, the call on my part would always be the same. But it may be related to the error from #102 or maybe the cells I receive from the notebook are not sorted. Is the error related to missing variables? Do you have a stack or error message for me? I did release a new update v6.2.3. This fixes some problem with variables. Please test it and if it does not solve your issue, please provide more details. thx

denisrossetre commented 8 months ago

I could not reproduce the problem deterministically -- the error was in the test of the business logic.

Basically, I'm calling an API to set a boolean to true, verifying that it is true using another call, setting it false, verifying that it is false, and those tests were randomly failing.

I'm going to test extensively this and report back.

denisrossetre commented 7 months ago

Seems to work fine! we can close the issue

AnWeber commented 7 months ago

thx for feedback