ibm-mas / cli

Maximo Application Suite command line interface
https://ibm-mas.github.io/cli/
Eclipse Public License 2.0
24 stars 18 forks source link

MAXMIS-745/859 Add cypress based test suite for the Civil operational map application #1317

Closed MaeveOReilly closed 3 days ago

MaeveOReilly commented 3 weeks ago

What

Add a test suite which runs a cypress test we run in travis (against mocked data) in FVT (against real data). The intention is only to add the type of UI smoke tests we do before release. The bulk of the UI testing will stay in travis only. We expect/hope that using same test code/framework in FVT as we have in Travis will reduce our cost of maintenance, and will break at build time before it can get as far deploy (FVT) time.

Issues

Epic - https://jsw.ibm.com/browse/MASR-1891

Testing

Tested locally and in personal fvt - https://dashboard.masdev.wiotp.sl.hursley.ibm.com/tests/fvtstable/testsuite/ibm-mas-manage/civil-api-defectdetection

image
unnati-solanki-git commented 4 days ago

@MaeveOReilly Can you share the pipeline sequence to visualize how it looks like!

MaeveOReilly commented 4 days ago

@MaeveOReilly Can you share the pipeline sequence to visualize how it looks like!

Hey Unnati - do you mean with 'pipeline sequence' a screenshot from openshift of it running? It comes directly after the manage-setup-is. I'll have to rerun pfvt to get that.

Edit - Rerunning pfvt to get screenshot and removed unused task (thanks @bmoferrall ).

MaeveOReilly commented 4 days ago

@unnati-solanki-git if there a way to make screenshots with the whole pipeline it isn't obvious to me!

left

image

right

image

So the fvt-ibm-mas-manage-cypress comes after the fvt-manage-setup-is, which is the only dependency (that is where the user + map is configured).

unnati-solanki-git commented 3 days ago

@MaeveOReilly Can you share the pipeline sequence to visualize how it looks like!

Hey Unnati - do you mean with 'pipeline sequence' a screenshot from openshift of it running? It comes directly after the manage-setup-is. I'll have to rerun pfvt to get that.

Edit - Rerunning pfvt to get screenshot and removed unused task (thanks @bmoferrall ).

There is quick and easy way to do this. I learnt it from @alequint

Here is the how: https://github.com/ibm-mas/cli/pull/1131#issuecomment-2243754022

Hope this helps in future PRs :)

unnati-solanki-git commented 3 days ago

@MaeveOReilly This sequence looks great

Just one thing now we have to do after this got merged. We need to observe that how it behaves in the official pipeline for next couple of runs considering the fact that it runs in parallel to selenium tests (fvt-manage-maintmanager-setup) 👍

Thanks!

MaeveOReilly commented 3 days ago

I had run it locally against the civil cluster as well local.txt