Closed mwouts closed 4 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 97.73%. Comparing base (
c37f3e0
) to head (e827858
).
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Hi @mahendrapaipuri , I am trying to update the UI tests as they fail on the CI, but I am not sure how to do this? Thanks!
Why are you updating the screenshots? If you look into the new screenshots you are trying to update, there are kernels that are being picked from your local test env like itables
, javascript
, etc. But in our UI test env, we are just installing bash
kernel to test the extension with a non-python kernel.
Normally, if you dont touch the extension code, you dont have to run the UI tests locally. If you really want to include more kernels in the test env (which I dont think it is necessary), you will need to update [test-ui]
dependencies in pyproject.toml
to install these kernels and then update screenshots.
Does it make sense?
Hi @mahendrapaipuri , thanks for your comment! Indeed you're correct I don't want to add a new kernel on the CI. The reason why I am trying to update the UI tests is that they currently fail on the main branch (see e.g. this run).
As I was not able to trigger an update through please update playwright snapshots (see my attempts above) I tried to update them locally, but as you point out that comes with more differences. Do you think you could trigger a UI test update, maybe on another branch? Thanks!
Hello @mwouts Understood. Some pointers that might be useful here:
main
, you can find those at the bottom of CI Summary page. This allows us to inspect why they are failing. Maybe we can add this in docs for future references. On the question why they are failing, the screenshots in artifacts tells us there is 3 px difference between actual and expected screenshots and that is why they are failing. We have a tolerance set, but this can always be a annoying issue.Thanks @mahendrapaipuri ! Oh it's great that I can download the updated UI results, I will make a PR from this! Re the automation, thanks for the pointers too.
Thank you for making this pull request.
Did you know? You can try it on Binder: or .
Also, the version of Jupytext developed in this PR can be installed with
pip
:(this requires
nodejs
, see more at Developing Jupytext)