checkly / public-roadmap

Checkly public roadmap. All planned features, updates and tweaks.
https://checklyhq.com
37 stars 7 forks source link

Timeout error should create a playwright video / trace (or at least some other debugging information) #271

Open KingTomaHawk opened 1 year ago

KingTomaHawk commented 1 year ago

💡 For general support requests and bug reports, please go to checklyhq.com/support

Is your feature request related to a problem? Please describe. When a browser check reaches its timeout and triggers a timeout error, no Playwright video / recording is created. The same happens in the code editor when the script is executed from there. Even the log does not provide any useful Information on which part of the code causes the error.

Describe the solution you'd like

  1. create a Playwright video / trace file when a timeout error occurs (in automatic interval mode).
  2. create a Playwright video / trace file when a timeout error occurs (when testing the code in the code editor).

Describe alternatives you've considered Implement an indicator in the log, that shows what may have led to these errors.

Additional context At the moment the user has no indictor what is suddenly causing the timeout error. This is why I'm placing a screenshot commands after a few lines of code, to see where the code got stuck.

KingTomaHawk commented 1 year ago

Edit: It seems like, a Playwright video / trace gets created on timeout, when the timeout is set smaller then 120000 ms. I changed it to 80000 and I get reports. Is this intended?

tnolet commented 1 year ago

Hey @KingTomaHawk thanks for the feedback. We are working hard on getting playwright/test support from beta to GA so this is valuable feedback. I pinged the engineering team working in this.