search

wearefrank / ladybug

Enable users of your application to debug and test it
Apache License 2.0
13 stars 8 forks source link

Rerunning a ladybug report succeeds unexpectedly #284

Open mhdirkse opened 1 month ago

mhdirkse commented 1 month ago

I had a report in the test tab that I wanted to rerun. I edited it with the intention to let it fail. Rerunning succeeded however.

I clicked Compare to see whether my edit had taken effect. It had according to the following screenshot:

image

MatthijsSmets commented 3 weeks ago

This looks more like a backend issue, as the frontend only shows the result and does not actually influence the succes or failure of a report.

MatthijsSmets commented 3 weeks ago

I have transferred this to the backend repository as this is not a frontend problem.

jacodg commented 3 weeks ago

@mhdirkse can you show this to me? Or add more info to this issue? I would especially be interested to see the Report xml (first node of the tree) because Ladybug compares that xml to determine whether reports are the same

mhdirkse commented 4 days ago

Het resultaat is met de nieuwste code van ladybug, ladybug-frontend en frankframework iets anders:

Image

Als ik naar de root node ga dan zie ik dit:

Image

Dit is lang niet alle XML die ik had verwacht; heeft er misschien mee te maken dat de black box view geselecteerd is. Maar als ik de white box view selecteer dan zie ik nog steeds maar twee checkpoints.

mhdirkse commented 4 days ago

Lijkt op https://github.com/wearefrank/ladybug-frontend/issues/664

mhdirkse commented 4 days ago

Ik heb een meeting ingeschoten met @MatthijsSmets en @jacodg om samen naar het gedrag van de compare tab te kijken.