search

UnitTestBot / usvm

Universal Symbolic Virtual Machine
Apache License 2.0
18 stars 17 forks source link

Multiple `UTestExecutionInitFailedResult` without cause as a result of class analysis #145

Open EgorkaKulikov opened 9 months ago

EgorkaKulikov commented 9 months ago

Run ContestEstimator with the following options:

timeLimit = 120
methodFilter = "spoon.reflect.visitor.ImportScannerImpl.*"
projectFilter = listOf("spoon")

The are multiple similar warnings in logs (absolutely unimformative about real problem reasons, because executionResult.cause is absent). As a result, coverage for this class is about 3%

12:15:49.114 | WARN  | Execution failed before method under test call on (id:21)spoon.reflect.visitor.ImportScannerImpl#isInCollisionWithLocalMethod(spoon.reflect.reference.CtExecutableReference)
java.lang.Exception: 
12:15:49.132 | WARN  | Execution failed before method under test call on (id:21)spoon.reflect.visitor.ImportScannerImpl#isInCollisionWithLocalMethod(spoon.reflect.reference.CtExecutableReference)
java.lang.Exception: 
12:15:49.328 | WARN  | Execution failed before method under test call on (id:21)spoon.reflect.visitor.ImportScannerImpl#computeImports(spoon.reflect.declaration.CtElement)
java.lang.Exception: 
12:15:49.351 | WARN  | Execution failed before method under test call on (id:21)spoon.reflect.visitor.ImportScannerImpl#computeImports(spoon.reflect.declaration.CtElement)
java.lang.Exception: 
12:15:49.368 | WARN  | Execution failed before method under test call on (id:21)spoon.reflect.visitor.ImportScannerImpl#computeImports(spoon.reflect.declaration.CtElement)
java.lang.Exception: 
12:15:49.386 | WARN  | Execution failed before method under test call on (id:21)spoon.reflect.visitor.ImportScannerImpl#computeImports(spoon.reflect.declaration.CtElement)
java.lang.Exception: 
12:15:50.498 | WARN  | Execution failed before method under test call on (id:21)spoon.reflect.visitor.ImportScannerImpl#visitCtCatchVariable(spoon.reflect.code.CtCatchVariable)
java.lang.Exception: 
12:15:50.577 | WARN  | Execution failed before method under test call on (id:21)spoon.reflect.visitor.ImportScannerImpl#visitCtCatchVariable(spoon.reflect.code.CtCatchVariable)
java.lang.Exception:
EgorkaKulikov commented 9 months ago

This is a very popular problem on spoon project. As a result, we have very bad coverage. @Damtev, please take into account too.

Damtev commented 9 months ago

There is something wrong either in the methodFilter or in the project - they do not match with each other. @EgorkaKulikov please, check.

EgorkaKulikov commented 9 months ago

Sorry @Damtev , typical copypaste problem. fixed.