search

UnitTestBot / UTBotJava

Automated unit test generation and precise code analysis for Java
Apache License 2.0
132 stars 39 forks source link

Empty test classes for Booleans and Shorts are generated by Contest Estimator #1718

Closed alisevych closed 1 year ago

alisevych commented 1 year ago

Description

Empty test classes for Booleans and Shorts are generated by Contest Estimator

To Reproduce

  1. Run the 'utbot' project in IntelliJ Idea 2022.2.4
  2. Open utbot-junit-contest/src/main/kotlin/org/utbot/contest/ContestEstimator.kt
  3. Change javaHome property to full local path to JDK 8
  4. Change timeLimit in fun main to 120
  5. In fun main change: projectFilter = listOf("guava-26.0")
  6. Run fun main - make sure to set JRE in Edit Configurations to JDK 8.
  7. Wait tests are generated in utbot-junit-contest/build/output/test/guava-26.0
  8. Check utbot-junit-contest/build/output/test/guava-26.0/com/google/common/primitives

Expected behavior

Tests are supposed to be generated.

Actual behavior

Empty test classes are generated for Booleans and Shorts.

Visual proofs (screenshots, logs, images)

Log record for Shorts: // same for Booleans canceled by timeout = true #methods = 49, #methods started symbolic exploration = 49 #methods with at least one TC = 0 #methods with exceptions = 0 #generated TC = 0 #total coverage = 0/0 #fuzzed coverage = 0/0 #concolic coverage = 0/0 ~~~ 3:18:20.600 | INFO | ClassUnderTest[ FQN: com.google.common.primitives.Shorts classfileDir: C:\Users\lWX1182794\UTBotJava\utbot-junit-contest\build\output\unzipped\guava-26.0 testClassSimpleName: ShortsTest generatedTestFile: C:\Users\lWX1182794\UTBotJava\utbot-junit-contest\build\output\test_candidates\guava-26.0\com\google\common\primitives\ShortsTest.java generatedTestsSourcesDir: utbot-junit-contest\build\output\test_candidates\guava-26.0 ] 13:18:20.600 | INFO | Started: class com.google.common.primitives.Shorts 13:18:20.600 | INFO | Started: preparation class class com.google.common.primitives.Shorts: kotlin reflection :: run 13:18:20.611 | INFO | Finished (in 0.011 sec): preparation class class com.google.common.primitives.Shorts: kotlin reflection :: run 13:18:20.611 | INFO | Started: 2nd optional soot initialization 13:18:21.881 | INFO | Finished (in 1.270 sec): 2nd optional soot initialization 13:18:21.904 | DEBUG | ... 13:18:21.904 | INFO | Started: method com.google.common.primitives.Shorts.hashCode 13:18:21.905 | INFO | -- Remaining time budget: 100695 ms, #remaining_methods: 49, budget for method: 2055 ms, solver timeout: 1000 ms, budget for symbolic execution: 1028 ms, budget for concrete execution: 1027 ms, -- 13:18:22.968 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.hashCode 13:18:24.019 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.hashCode 13:18:24.021 | INFO | Finished (in 2.116 sec): method com.google.common.primitives.Shorts.hashCode : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:24.022 | DEBUG | ... 13:18:24.022 | INFO | Started: method com.google.common.primitives.Shorts.min 13:18:24.022 | INFO | -- Remaining time budget: 98577 ms, #remaining_methods: 48, budget for method: 2053 ms, solver timeout: 1000 ms, budget for symbolic execution: 1027 ms, budget for concrete execution: 1026 ms, -- 13:18:25.052 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.min 13:18:26.092 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.min 13:18:26.094 | INFO | Finished (in 2.072 sec): method com.google.common.primitives.Shorts.min : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:26.094 | DEBUG | ... 13:18:26.094 | INFO | Started: method com.google.common.primitives.Shorts.max 13:18:26.094 | INFO | -- Remaining time budget: 96505 ms, #remaining_methods: 47, budget for method: 2053 ms, solver timeout: 1000 ms, budget for symbolic execution: 1027 ms, budget for concrete execution: 1026 ms, -- 13:18:27.137 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.max 13:18:28.170 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.max 13:18:28.171 | INFO | Finished (in 2.077 sec): method com.google.common.primitives.Shorts.max : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:28.171 | DEBUG | ... 13:18:28.171 | INFO | Started: method com.google.common.primitives.Shorts.indexOf 13:18:28.171 | INFO | -- Remaining time budget: 94428 ms, #remaining_methods: 46, budget for method: 2052 ms, solver timeout: 1000 ms, budget for symbolic execution: 1026 ms, budget for concrete execution: 1026 ms, -- 13:18:29.205 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.indexOf 13:18:30.232 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.indexOf 13:18:30.233 | INFO | Finished (in 2.062 sec): method com.google.common.primitives.Shorts.indexOf : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:30.233 | DEBUG | ... 13:18:30.233 | INFO | Started: method com.google.common.primitives.Shorts.indexOf 13:18:30.233 | INFO | -- Remaining time budget: 92366 ms, #remaining_methods: 45, budget for method: 2052 ms, solver timeout: 1000 ms, budget for symbolic execution: 1026 ms, budget for concrete execution: 1026 ms, -- 13:18:31.267 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.indexOf 13:18:32.299 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.indexOf 13:18:32.300 | INFO | Finished (in 2.067 sec): method com.google.common.primitives.Shorts.indexOf : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:32.301 | DEBUG | ... 13:18:32.301 | INFO | Started: method com.google.common.primitives.Shorts.indexOf 13:18:32.301 | INFO | -- Remaining time budget: 90298 ms, #remaining_methods: 44, budget for method: 2052 ms, solver timeout: 1000 ms, budget for symbolic execution: 1026 ms, budget for concrete execution: 1026 ms, -- 13:18:33.332 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.indexOf 13:18:34.362 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.indexOf 13:18:34.363 | INFO | Finished (in 2.062 sec): method com.google.common.primitives.Shorts.indexOf : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:34.363 | DEBUG | ... 13:18:34.363 | INFO | Started: method com.google.common.primitives.Shorts.lastIndexOf 13:18:34.363 | INFO | -- Remaining time budget: 88236 ms, #remaining_methods: 43, budget for method: 2052 ms, solver timeout: 1000 ms, budget for symbolic execution: 1026 ms, budget for concrete execution: 1026 ms, -- 13:18:35.393 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.lastIndexOf 13:18:36.427 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.lastIndexOf 13:18:36.428 | INFO | Finished (in 2.064 sec): method com.google.common.primitives.Shorts.lastIndexOf : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:36.428 | DEBUG | ... 13:18:36.428 | INFO | Started: method com.google.common.primitives.Shorts.lastIndexOf 13:18:36.428 | INFO | -- Remaining time budget: 86171 ms, #remaining_methods: 42, budget for method: 2051 ms, solver timeout: 1000 ms, budget for symbolic execution: 1026 ms, budget for concrete execution: 1025 ms, -- 13:18:37.460 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.lastIndexOf 13:18:38.493 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.lastIndexOf 13:18:38.495 | INFO | Finished (in 2.066 sec): method com.google.common.primitives.Shorts.lastIndexOf : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:38.495 | DEBUG | ... 13:18:38.495 | INFO | Started: method com.google.common.primitives.Shorts.concat 13:18:38.495 | INFO | -- Remaining time budget: 84104 ms, #remaining_methods: 41, budget for method: 2051 ms, solver timeout: 1000 ms, budget for symbolic execution: 1026 ms, budget for concrete execution: 1025 ms, -- 13:18:39.525 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.concat 13:18:40.554 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.concat 13:18:40.555 | INFO | Finished (in 2.060 sec): method com.google.common.primitives.Shorts.concat : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:40.555 | DEBUG | ... 13:18:40.555 | INFO | Started: method com.google.common.primitives.Shorts.contains 13:18:40.555 | INFO | -- Remaining time budget: 82044 ms, #remaining_methods: 40, budget for method: 2051 ms, solver timeout: 1000 ms, budget for symbolic execution: 1026 ms, budget for concrete execution: 1025 ms, -- 13:18:41.590 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.contains 13:18:42.622 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.contains 13:18:42.623 | INFO | Finished (in 2.068 sec): method com.google.common.primitives.Shorts.contains : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:42.623 | DEBUG | ... 13:18:42.623 | INFO | Started: method com.google.common.primitives.Shorts.join 13:18:42.623 | INFO | -- Remaining time budget: 79976 ms, #remaining_methods: 39, budget for method: 2050 ms, solver timeout: 1000 ms, budget for symbolic execution: 1025 ms, budget for concrete execution: 1025 ms, -- 13:18:43.652 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.join 13:18:44.690 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.join 13:18:44.691 | INFO | Finished (in 2.068 sec): method com.google.common.primitives.Shorts.join : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:44.691 | DEBUG | ... 13:18:44.691 | INFO | Started: method com.google.common.primitives.Shorts.compare 13:18:44.691 | INFO | -- Remaining time budget: 77908 ms, #remaining_methods: 38, budget for method: 2050 ms, solver timeout: 1000 ms, budget for symbolic execution: 1025 ms, budget for concrete execution: 1025 ms, -- 13:18:45.720 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.compare 13:18:46.748 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.compare 13:18:46.749 | INFO | Finished (in 2.059 sec): method com.google.common.primitives.Shorts.compare : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:46.749 | DEBUG | ... 13:18:46.749 | INFO | Started: method com.google.common.primitives.Shorts.toArray 13:18:46.749 | INFO | -- Remaining time budget: 75850 ms, #remaining_methods: 37, budget for method: 2050 ms, solver timeout: 1000 ms, budget for symbolic execution: 1025 ms, budget for concrete execution: 1025 ms, -- 13:18:47.778 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.toArray 13:18:48.808 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.toArray 13:18:48.824 | INFO | Finished (in 2.074 sec): method com.google.common.primitives.Shorts.toArray : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:48.824 | DEBUG | ... 13:18:48.824 | INFO | Started: method com.google.common.primitives.Shorts.asList 13:18:48.824 | INFO | -- Remaining time budget: 73775 ms, #remaining_methods: 36, budget for method: 2049 ms, solver timeout: 1000 ms, budget for symbolic execution: 1025 ms, budget for concrete execution: 1024 ms, -- 13:18:49.857 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.asList 13:18:50.884 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.asList 13:18:50.886 | INFO | Finished (in 2.062 sec): method com.google.common.primitives.Shorts.asList : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:50.886 | DEBUG | ... 13:18:50.886 | INFO | Started: method com.google.common.primitives.Shorts.ensureCapacity 13:18:50.886 | INFO | -- Remaining time budget: 71713 ms, #remaining_methods: 35, budget for method: 2048 ms, solver timeout: 1000 ms, budget for symbolic execution: 1024 ms, budget for concrete execution: 1024 ms, -- 13:18:51.920 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.ensureCapacity 13:18:52.948 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.ensureCapacity 13:18:52.949 | INFO | Finished (in 2.063 sec): method com.google.common.primitives.Shorts.ensureCapacity : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:52.950 | DEBUG | ... 13:18:52.950 | INFO | Started: method com.google.common.primitives.Shorts.reverse 13:18:52.950 | INFO | -- Remaining time budget: 69649 ms, #remaining_methods: 34, budget for method: 2048 ms, solver timeout: 1000 ms, budget for symbolic execution: 1024 ms, budget for concrete execution: 1024 ms, -- 13:18:53.987 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.reverse 13:18:55.020 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.reverse 13:18:55.022 | INFO | Finished (in 2.072 sec): method com.google.common.primitives.Shorts.reverse : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:55.022 | DEBUG | ... 13:18:55.022 | INFO | Started: method com.google.common.primitives.Shorts.reverse 13:18:55.022 | INFO | -- Remaining time budget: 67577 ms, #remaining_methods: 33, budget for method: 2047 ms, solver timeout: 1000 ms, budget for symbolic execution: 1024 ms, budget for concrete execution: 1023 ms, -- 13:18:56.047 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.reverse 13:18:57.079 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.reverse 13:18:57.080 | INFO | Finished (in 2.058 sec): method com.google.common.primitives.Shorts.reverse : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:57.080 | DEBUG | ... 13:18:57.080 | INFO | Started: method com.google.common.primitives.Shorts.toByteArray 13:18:57.080 | INFO | -- Remaining time budget: 65519 ms, #remaining_methods: 32, budget for method: 2047 ms, solver timeout: 1000 ms, budget for symbolic execution: 1024 ms, budget for concrete execution: 1023 ms, -- 13:18:58.109 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.toByteArray 13:18:59.140 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.toByteArray 13:18:59.141 | INFO | Finished (in 2.060 sec): method com.google.common.primitives.Shorts.toByteArray : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:18:59.141 | DEBUG | ... 13:18:59.141 | INFO | Started: method com.google.common.primitives.Shorts.sortDescending 13:18:59.141 | INFO | -- Remaining time budget: 63458 ms, #remaining_methods: 31, budget for method: 2047 ms, solver timeout: 1000 ms, budget for symbolic execution: 1024 ms, budget for concrete execution: 1023 ms, -- 13:19:00.175 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.sortDescending 13:19:01.208 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.sortDescending 13:19:01.209 | INFO | Finished (in 2.068 sec): method com.google.common.primitives.Shorts.sortDescending : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:01.209 | DEBUG | ... 13:19:01.209 | INFO | Started: method com.google.common.primitives.Shorts.sortDescending 13:19:01.209 | INFO | -- Remaining time budget: 61390 ms, #remaining_methods: 30, budget for method: 2046 ms, solver timeout: 1000 ms, budget for symbolic execution: 1023 ms, budget for concrete execution: 1023 ms, -- 13:19:02.241 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.sortDescending 13:19:03.270 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.sortDescending 13:19:03.272 | INFO | Finished (in 2.062 sec): method com.google.common.primitives.Shorts.sortDescending : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:03.272 | DEBUG | ... 13:19:03.272 | INFO | Started: method com.google.common.primitives.Shorts.stringConverter 13:19:03.272 | INFO | -- Remaining time budget: 59327 ms, #remaining_methods: 29, budget for method: 2045 ms, solver timeout: 1000 ms, budget for symbolic execution: 1023 ms, budget for concrete execution: 1022 ms, -- 13:19:04.302 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.stringConverter 13:19:05.336 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.stringConverter 13:19:05.350 | INFO | Finished (in 2.079 sec): method com.google.common.primitives.Shorts.stringConverter :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:05.351 | DEBUG | ... 13:19:05.351 | INFO | Started: method com.google.common.primitives.Shorts.constrainToRange 13:19:05.351 | INFO | -- Remaining time budget: 57248 ms, #remaining_methods: 28, budget for method: 2044 ms, solver timeout: 1000 ms, budget for symbolic execution: 1022 ms, budget for concrete execution: 1022 ms, -- 13:19:06.386 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.constrainToRange 13:19:07.414 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.constrainToRange 13:19:07.416 | INFO | Finished (in 2.065 sec): method com.google.common.primitives.Shorts.constrainToRange : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:07.416 | DEBUG | ... 13:19:07.417 | INFO | Started: method com.google.common.primitives.Shorts.checkedCast 13:19:07.417 | INFO | -- Remaining time budget: 55183 ms, #remaining_methods: 27, budget for method: 2043 ms, solver timeout: 1000 ms, budget for symbolic execution: 1022 ms, budget for concrete execution: 1021 ms, -- 13:19:08.442 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.checkedCast 13:19:09.467 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.checkedCast 13:19:09.469 | INFO | Finished (in 2.053 sec): method com.google.common.primitives.Shorts.checkedCast : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:09.469 | DEBUG | ... 13:19:09.469 | INFO | Started: method com.google.common.primitives.Shorts.saturatedCast 13:19:09.470 | INFO | -- Remaining time budget: 53130 ms, #remaining_methods: 26, budget for method: 2043 ms, solver timeout: 1000 ms, budget for symbolic execution: 1022 ms, budget for concrete execution: 1021 ms, -- 13:19:10.495 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.saturatedCast 13:19:11.525 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.saturatedCast 13:19:11.526 | INFO | Finished (in 2.057 sec): method com.google.common.primitives.Shorts.saturatedCast : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:11.527 | DEBUG | ... 13:19:11.527 | INFO | Started: method com.google.common.primitives.Shorts.lexicographicalComparator 13:19:11.527 | INFO | -- Remaining time budget: 51072 ms, #remaining_methods: 25, budget for method: 2042 ms, solver timeout: 1000 ms, budget for symbolic execution: 1021 ms, budget for concrete execution: 1021 ms, -- 13:19:12.559 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.lexicographicalComparator 13:19:13.595 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.lexicographicalComparator 13:19:13.596 | INFO | Finished (in 2.068 sec): method com.google.common.primitives.Shorts.lexicographicalComparator :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:13.596 | DEBUG | ... 13:19:13.596 | INFO | Started: method com.google.common.primitives.Shorts.fromByteArray 13:19:13.596 | INFO | -- Remaining time budget: 49003 ms, #remaining_methods: 24, budget for method: 2041 ms, solver timeout: 1000 ms, budget for symbolic execution: 1021 ms, budget for concrete execution: 1020 ms, -- 13:19:14.628 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.fromByteArray 13:19:15.658 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.fromByteArray 13:19:15.659 | INFO | Finished (in 2.063 sec): method com.google.common.primitives.Shorts.fromByteArray : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:15.659 | DEBUG | ... 13:19:15.659 | INFO | Started: method com.google.common.primitives.Shorts.fromBytes 13:19:15.659 | INFO | -- Remaining time budget: 46940 ms, #remaining_methods: 23, budget for method: 2040 ms, solver timeout: 1000 ms, budget for symbolic execution: 1020 ms, budget for concrete execution: 1020 ms, -- 13:19:16.693 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts.fromBytes 13:19:17.714 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts.fromBytes 13:19:17.714 | INFO | Finished (in 2.056 sec): method com.google.common.primitives.Shorts.fromBytes : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:17.714 | DEBUG | ... 13:19:17.714 | INFO | Started: method com.google.common.primitives.Shorts. 13:19:17.714 | INFO | -- Remaining time budget: 44885 ms, #remaining_methods: 22, budget for method: 2040 ms, solver timeout: 1000 ms, budget for symbolic execution: 1020 ms, budget for concrete execution: 1020 ms, -- 13:19:18.744 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts. 13:19:19.774 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts. 13:19:19.776 | INFO | Finished (in 2.062 sec): method com.google.common.primitives.Shorts. :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:19.776 | DEBUG | ... 13:19:19.776 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.get 13:19:19.776 | INFO | -- Remaining time budget: 42823 ms, #remaining_methods: 21, budget for method: 2039 ms, solver timeout: 1000 ms, budget for symbolic execution: 1020 ms, budget for concrete execution: 1019 ms, -- 13:19:20.809 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.get 13:19:21.844 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.get 13:19:21.855 | INFO | Finished (in 2.078 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.get :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:21.855 | DEBUG | ... 13:19:21.855 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.equals 13:19:21.855 | INFO | -- Remaining time budget: 40744 ms, #remaining_methods: 20, budget for method: 2037 ms, solver timeout: 1000 ms, budget for symbolic execution: 1019 ms, budget for concrete execution: 1018 ms, -- 13:19:22.879 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.equals 13:19:23.898 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.equals 13:19:23.901 | INFO | Finished (in 2.046 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.equals :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:23.901 | DEBUG | ... 13:19:23.901 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.toString 13:19:23.901 | INFO | -- Remaining time budget: 38698 ms, #remaining_methods: 19, budget for method: 2036 ms, solver timeout: 1000 ms, budget for symbolic execution: 1018 ms, budget for concrete execution: 1018 ms, -- 13:19:24.920 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.toString 13:19:25.939 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.toString 13:19:25.950 | INFO | Finished (in 2.049 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.toString :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:25.951 | DEBUG | ... 13:19:25.951 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.hashCode 13:19:25.951 | INFO | -- Remaining time budget: 36648 ms, #remaining_methods: 18, budget for method: 2036 ms, solver timeout: 1000 ms, budget for symbolic execution: 1018 ms, budget for concrete execution: 1018 ms, -- 13:19:26.984 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.hashCode 13:19:28.009 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.hashCode 13:19:28.010 | INFO | Finished (in 2.059 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.hashCode :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:28.010 | DEBUG | ... 13:19:28.010 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.indexOf 13:19:28.010 | INFO | -- Remaining time budget: 34589 ms, #remaining_methods: 17, budget for method: 2034 ms, solver timeout: 1000 ms, budget for symbolic execution: 1017 ms, budget for concrete execution: 1017 ms, -- 13:19:29.039 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.indexOf 13:19:30.065 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.indexOf 13:19:30.070 | INFO | Finished (in 2.060 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.indexOf :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:30.070 | DEBUG | ... 13:19:30.070 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.isEmpty 13:19:30.070 | INFO | -- Remaining time budget: 32529 ms, #remaining_methods: 16, budget for method: 2033 ms, solver timeout: 1000 ms, budget for symbolic execution: 1017 ms, budget for concrete execution: 1016 ms, -- 13:19:31.092 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.isEmpty 13:19:32.120 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.isEmpty 13:19:32.120 | INFO | Finished (in 2.050 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.isEmpty :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:32.120 | DEBUG | ... 13:19:32.120 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.lastIndexOf 13:19:32.121 | INFO | -- Remaining time budget: 30479 ms, #remaining_methods: 15, budget for method: 2031 ms, solver timeout: 1000 ms, budget for symbolic execution: 1016 ms, budget for concrete execution: 1015 ms, -- 13:19:33.149 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.lastIndexOf 13:19:34.179 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.lastIndexOf 13:19:34.182 | INFO | Finished (in 2.061 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.lastIndexOf :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:34.182 | DEBUG | ... 13:19:34.182 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.contains 13:19:34.182 | INFO | -- Remaining time budget: 28417 ms, #remaining_methods: 14, budget for method: 2029 ms, solver timeout: 1000 ms, budget for symbolic execution: 1015 ms, budget for concrete execution: 1014 ms, -- 13:19:35.207 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.contains 13:19:36.222 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.contains 13:19:36.225 | INFO | Finished (in 2.043 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.contains :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:36.225 | DEBUG | ... 13:19:36.225 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.size 13:19:36.225 | INFO | -- Remaining time budget: 26374 ms, #remaining_methods: 13, budget for method: 2028 ms, solver timeout: 1000 ms, budget for symbolic execution: 1014 ms, budget for concrete execution: 1014 ms, -- 13:19:37.253 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.size 13:19:38.281 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.size 13:19:38.281 | INFO | Finished (in 2.055 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.size :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:38.281 | DEBUG | ... 13:19:38.281 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.subList 13:19:38.281 | INFO | -- Remaining time budget: 24318 ms, #remaining_methods: 12, budget for method: 2026 ms, solver timeout: 1000 ms, budget for symbolic execution: 1013 ms, budget for concrete execution: 1013 ms, -- 13:19:39.308 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.subList 13:19:40.328 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.subList 13:19:40.341 | INFO | Finished (in 2.060 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.subList :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:40.341 | DEBUG | ... 13:19:40.341 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.set 13:19:40.341 | INFO | -- Remaining time budget: 22258 ms, #remaining_methods: 11, budget for method: 2023 ms, solver timeout: 1000 ms, budget for symbolic execution: 1012 ms, budget for concrete execution: 1011 ms, -- 13:19:41.358 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.set 13:19:42.382 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.set 13:19:42.395 | INFO | Finished (in 2.054 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.set :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:42.395 | DEBUG | ... 13:19:42.396 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList.toShortArray 13:19:42.396 | INFO | -- Remaining time budget: 20204 ms, #remaining_methods: 10, budget for method: 2020 ms, solver timeout: 1000 ms, budget for symbolic execution: 1010 ms, budget for concrete execution: 1010 ms, -- 13:19:43.417 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList.toShortArray 13:19:44.430 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList.toShortArray 13:19:44.443 | INFO | Finished (in 2.048 sec): method com.google.common.primitives.Shorts$ShortArrayAsList.toShortArray :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:44.444 | DEBUG | ... 13:19:44.444 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList. 13:19:44.444 | INFO | -- Remaining time budget: 18155 ms, #remaining_methods: 9, budget for method: 2017 ms, solver timeout: 1000 ms, budget for symbolic execution: 1009 ms, budget for concrete execution: 1008 ms, -- 13:19:45.457 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList. 13:19:46.473 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList. 13:19:46.474 | INFO | Finished (in 2.031 sec): method com.google.common.primitives.Shorts$ShortArrayAsList. : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:46.474 | DEBUG | ... 13:19:46.474 | INFO | Started: method com.google.common.primitives.Shorts$ShortArrayAsList. 13:19:46.474 | INFO | -- Remaining time budget: 16125 ms, #remaining_methods: 8, budget for method: 2015 ms, solver timeout: 1000 ms, budget for symbolic execution: 1008 ms, budget for concrete execution: 1007 ms, -- 13:19:47.493 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortArrayAsList. 13:19:48.502 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortArrayAsList. 13:19:48.503 | INFO | Finished (in 2.029 sec): method com.google.common.primitives.Shorts$ShortArrayAsList. : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:48.503 | DEBUG | ... 13:19:48.503 | INFO | Started: method com.google.common.primitives.Shorts$LexicographicalComparator.toString 13:19:48.503 | INFO | -- Remaining time budget: 14096 ms, #remaining_methods: 7, budget for method: 2013 ms, solver timeout: 1000 ms, budget for symbolic execution: 1007 ms, budget for concrete execution: 1006 ms, -- 13:19:49.520 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$LexicographicalComparator.toString 13:19:50.536 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$LexicographicalComparator.toString 13:19:50.539 | INFO | Finished (in 2.035 sec): method com.google.common.primitives.Shorts$LexicographicalComparator.toString : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:50.539 | DEBUG | ... 13:19:50.539 | INFO | Started: method com.google.common.primitives.Shorts$LexicographicalComparator.compare 13:19:50.539 | INFO | -- Remaining time budget: 12060 ms, #remaining_methods: 6, budget for method: 2010 ms, solver timeout: 1000 ms, budget for symbolic execution: 1005 ms, budget for concrete execution: 1005 ms, -- 13:19:51.548 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$LexicographicalComparator.compare 13:19:52.562 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$LexicographicalComparator.compare 13:19:52.563 | INFO | Finished (in 2.024 sec): method com.google.common.primitives.Shorts$LexicographicalComparator.compare : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:52.563 | DEBUG | ... 13:19:52.563 | INFO | Started: method com.google.common.primitives.Shorts$ShortConverter.toString 13:19:52.563 | INFO | -- Remaining time budget: 10036 ms, #remaining_methods: 5, budget for method: 2007 ms, solver timeout: 1000 ms, budget for symbolic execution: 1004 ms, budget for concrete execution: 1003 ms, -- 13:19:53.577 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortConverter.toString 13:19:54.590 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortConverter.toString 13:19:54.591 | INFO | Finished (in 2.028 sec): method com.google.common.primitives.Shorts$ShortConverter.toString :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:54.591 | DEBUG | ... 13:19:54.591 | INFO | Started: method com.google.common.primitives.Shorts$ShortConverter.readResolve 13:19:54.591 | INFO | -- Remaining time budget: 8008 ms, #remaining_methods: 4, budget for method: 2002 ms, solver timeout: 1000 ms, budget for symbolic execution: 1001 ms, budget for concrete execution: 1001 ms, -- 13:19:55.607 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortConverter.readResolve 13:19:56.618 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortConverter.readResolve 13:19:56.638 | INFO | Finished (in 2.047 sec): method com.google.common.primitives.Shorts$ShortConverter.readResolve :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:56.638 | DEBUG | ... 13:19:56.638 | INFO | Started: method com.google.common.primitives.Shorts$ShortConverter.doForward 13:19:56.638 | INFO | -- Remaining time budget: 5961 ms, #remaining_methods: 3, budget for method: 1987 ms, solver timeout: 993 ms, budget for symbolic execution: 994 ms, budget for concrete execution: 993 ms, -- 13:19:57.637 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortConverter.doForward 13:19:58.635 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortConverter.doForward 13:19:58.659 | INFO | Finished (in 2.021 sec): method com.google.common.primitives.Shorts$ShortConverter.doForward :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:19:58.659 | DEBUG | ... 13:19:58.659 | INFO | Started: method com.google.common.primitives.Shorts$ShortConverter.doBackward 13:19:58.659 | INFO | -- Remaining time budget: 3940 ms, #remaining_methods: 2, budget for method: 1970 ms, solver timeout: 985 ms, budget for symbolic execution: 985 ms, budget for concrete execution: 985 ms, -- 13:19:59.651 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortConverter.doBackward 13:20:00.637 | INFO | (X) Cancelling concrete execution: com.google.common.primitives.Shorts$ShortConverter.doBackward 13:20:00.638 | INFO | Finished (in 1.978 sec): method com.google.common.primitives.Shorts$ShortConverter.doBackward :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:20:00.638 | DEBUG | ... 13:20:00.638 | INFO | Started: method com.google.common.primitives.Shorts$ShortConverter. 13:20:00.638 | INFO | -- Remaining time budget: 1961 ms, #remaining_methods: 1, budget for method: 1961 ms, solver timeout: 980 ms, budget for symbolic execution: 981 ms, budget for concrete execution: 980 ms, -- 13:20:01.632 | INFO | |> Starting concrete execution for remaining state: com.google.common.primitives.Shorts$ShortConverter. 13:20:02.606 | WARN | Cancelling job because timeout 102000 ms elapsed (real cancellation can take time) 13:20:02.617 | INFO | Finished (in 1.978 sec): method com.google.common.primitives.Shorts$ShortConverter. :: EXCEPTION :: : SUSPICIOUS #generatedTC=0 WITH NO EXCEPTIONS 13:20:02.617 | ERROR | Internal job error kotlinx.coroutines.JobCancellationException: StandaloneCoroutine was cancelled 13:20:02.623 | INFO | Started: Flushing tests for [Shorts] on disk 13:20:02.624 | INFO | File size for ShortsTest: 73 bytes 13:20:02.626 | INFO | Finished (in 0.003 sec): Flushing tests for [Shorts] on disk 13:20:02.626 | INFO | Finished (in 102.026 sec): class com.google.common.primitives.Shorts : canceled by timeout = true #methods = 49, #methods started symbolic exploration = 49 #methods with at least one TC = 0 #methods with exceptions = 0 #generated TC = 0 #total coverage = 0/0 #fuzzed coverage = 0/0 #concolic coverage = 0/0 13:20:02.626 | INFO | Started: Compiling class C:\Users\lWX1182794\UTBotJava\utbot-junit-contest\build\output\test_candidates\guava-26.0\com\google\common\primitives\ShortsTest.java 13:20:02.631 | DEBUG | Compile attempt 1 13:20:05.008 | INFO | Moved successfully compiled file into C:\Users\lWX1182794\UTBotJava\utbot-junit-contest\build\output\test\guava-26.0\com\google\common\primitives\ShortsTest.java 13:20:05.008 | INFO | Finished (in 2.382 sec): Compiling class C:\Users\lWX1182794\UTBotJava\utbot-junit-contest\build\output\test_candidates\guava-26.0\com\google\common\primitives\ShortsTest.java ~~~
**Environment** _Substitute this text with an information that can help us to recreate the environment. For instance, specify Java version, test framework with a version (JUnit, TestNG...), Mockito configuration (packages, classes, statics), were the test parametrized or not and so on._ **Additional context** Add any other context about the problem here.
alisevych commented 1 year ago

@Markoutte Seems to be related to unexpected end/crash of test generation. When only Booleans and Shorts are left in list for guava-26.0:

com.google.common.primitives.Booleans
com.google.common.primitives.Shorts

=> they have very good coverage and 100+ test cases in test classes.

Domonion commented 1 year ago

May be important: Stable with @alisevych list file, no coverage for class Shorts,

Also:

  1. With fuzzingRatio = 0 - always finds some cases
  2. Otherwise when starting generating test cases for second class - instrumented process receives no queries about Short. logs contains information that fuzzing stopped on Cancellation for Concrete Execution