CARiSMA-Tool / carisma-tool

Implementation of the CARiSMA Tool
https://github.com/CARiSMA-Tool/carisma-tool
Eclipse Public License 1.0
3 stars 5 forks source link

Investigate cause for failure of JUnit tests related to Evolution extension(s) #25

Open nuthub opened 1 year ago

nuthub commented 1 year ago
tests/carisma.check.smartcard.evolution.tests/src/carisma/check/smartcard/evolution/authorizedstatuscheck/AuthorizedStatusEvolutionChecksTest.java
tests/carisma.check.smartcard.evolution.tests/src/carisma/check/smartcard/evolution/authorizedstatuscheck/AuthorizedStatusEvolutionDeltaOnlyCheckTest.java
tests/carisma.check.smartcard.evolution.tests/src/carisma/check/smartcard/evolution/lockedstatuscheck/LockedStatusEvolutionDeltaOnlyCheckTest.java
tests/carisma.check.staticcheck.evolution.tests/src/carisma/check/staticcheck/evolution/securedependency/SecureDependencyEvolutionCheckTest.java
tests/carisma.check.staticcheck.evolution.tests/src/carisma/check/staticcheck/evolution/securelinks/SecureLinksEvolutionCheckTest.java
tests/carisma.evolution.tests/src/carisma/tool/evolution/DeltaFactoryTest.java
tests/carisma.evolution.uml2.tests/src/carisma/tool/evolution/uml2/UMLModifierElementFactoryTest.java
tests/carisma.evolution.uml2.tests/src/carisma/tool/evolution/uml2/UMLModifierTest.java
tests/carisma.evolution.uml2.tests/src/carisma/tool/evolution/uml2/io/ExporterTest.java
tests/carisma.evolution.uml2.tests/src/carisma/tool/evolution/uml2/io/ImporterTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/AddAllTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/AllTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/AsteriskTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/BBKeepTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/CommonTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/ComplexChangesParserTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/CopyTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/DelAllTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/EditTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/KRKeepTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/MoveTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/SubstAllTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/SubstTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/UMLchangeParserStereotype_allTest.java
tests/carisma.evolution.uml2.umlchange.tests/src/carisma/tool/evolution/uml2/umlchange/UMLchangeValidatorTest.java
tests/carisma.umlchange.efficiency.tests/src/carisma/check/umlchange/efficiency/TestTest.java
APHDKO commented 4 months ago

@SvenPeldszus Do you know, whether true or false is the respected result in ​https://github.com/CARiSMA-Tool/carisma-tool/blob/a255388e20788893dc0a7a7fc9c637bbc475e29b/tests/carisma.check.staticcheck.evolution.tests/src/carisma/check/staticcheck/evolution/securelinks/SecureLinksEvolutionCheckTest.java#L206

SvenPeldszus commented 4 months ago

As far as I understand the checks, the method perform must always return true. However, this only indicates that the check has been executed without errors but does not indicate anything about the outcome of the check. To get the actual result you have to get the results messages from the AnalysisHost.