SNAPSHOT dependency is no longer available in the remote maven repositories

Dear Developers, I would like to report an issue that impacts the reproduction of Bears bugs. Take bears_FasterXML-jackson-databind_214497429-214500046 as an example, when I checkout it and try to compile it, the following error occurs:

(base) apr@apr:/mnt/data/bears_FasterXML-jackson-databind_214497429-214500046$ mvn clean compilePicked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[INFO] Scanning for projects...
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building jackson-databind 2.8.8-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: https://oss.sonatype.org/content/repositories/snapshots/com/fasterxml/jackson/core/jackson-core/2.8.8-SNAPSHOT/maven-metadata.xml
Downloading: https://oss.sonatype.org/content/repositories/snapshots/com/fasterxml/jackson/core/jackson-core/2.8.8-SNAPSHOT/jackson-core-2.8.8-SNAPSHOT.pom
[WARNING] The POM for com.fasterxml.jackson.core:jackson-core:jar:2.8.8-SNAPSHOT is missing, no dependency information available
[WARNING] The artifact javax.measure:jsr-275:jar:1.0.0 has been relocated to javax.measure:jsr-275:jar:0.9.1
Downloading: https://oss.sonatype.org/content/repositories/snapshots/com/fasterxml/jackson/core/jackson-core/2.8.8-SNAPSHOT/jackson-core-2.8.8-SNAPSHOT.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 4.083 s
[INFO] Finished at: 2021-12-18T19:47:15+08:00
[INFO] Final Memory: 18M/292M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project jackson-databind: Could not resolve dependencies for project com.fasterxml.jackson.core:jackson-databind:bundle:2.8.8-SNAPSHOT: Could not find artifact com.fasterxml.jackson.core:jackson-core:jar:2.8.8-SNAPSHOT in sonatype-nexus-snapshots (https://oss.sonatype.org/content/repositories/snapshots) -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

This results from the unavailability of the corresponding snapshot version of com.fasterxml.jackson.core in the remote repositories. Therefore, I fail to reproduce this bug.

A workaround is to download the source code of com.fasterxml.jackson.core , checkout its corresponding snapshot version, and install it locally. But this may be too time-consuming and not generalizable to other similar occasions.

It would be sincerely appreciated if any support or advice could be provided. Thank you!

Just a bit of modification worked for me.

If the build failed and stdout has the text below, modify the version in pom.xml com.fasterxml.jackson.core:jackson-core:jar:2.8.8-SNAPSHOT is missing

It could be easily automated, but I think the modification applied in advance might be the best.

diff --git a/pom.xml b/pom.xml
index 268c92154..451d05463 100644
--- a/pom.xml
+++ b/pom.xml
@@ -50,7 +50,7 @@
     <dependency>
       <groupId>com.fasterxml.jackson.core</groupId>
       <artifactId>jackson-core</artifactId>
-      <version>2.8.8-SNAPSHOT</version>
+      <version>2.8.8</version>
     </dependency>

     <!-- and for testing we need a few libraries

I confirm that some dependencies are missing for 80 Bears bugs:

Activiti-Activiti-357660134-359342518
aicis-fresco-330883035-330923179
aicis-fresco-335666803-335692003
aicis-fresco-363993941-363994940
aicis-fresco-370467437-370477490
aicis-fresco-370628089-370634151
apache-incubator-dubbo-329355311-329773929
apache-incubator-dubbo-347256120-347634018
apache-incubator-dubbo-352635276-352657297
apache-incubator-dubbo-370383941-370422750
apache-incubator-dubbo-450828157-450884276
apache-incubator-servicecomb-java-chassis-330826674-331080091
apache-incubator-servicecomb-java-chassis-371353019-371886679
apache-jackrabbit-oak-344414751-344705279
apereo-java-cas-client-408206584-439486928
awslabs-amazon-kinesis-client-446289265-452166805
AxonFramework-AxonFramework-451926440-451937647
CorfuDB-CorfuDB-330246430-330267605
cpesch-RouteConverter-331125693-331749933
cpesch-RouteConverter-432166807-432169636
ctripcorp-apollo-444069339-444288772
danfickle-openhtmltopdf-445988164-446994292
debezium-debezium-324021438-324040188
debezium-debezium-324040188-324047191
debezium-debezium-325431120-326310450
dhis2-dhis2-core-365246679-365386294
EnMasseProject-enmasse-344863667-344945686
EnMasseProject-enmasse-344945686-344976598
EnMasseProject-enmasse-357424637-357457887
FasterXML-jackson-databind-214497429-214500046
FasterXML-jackson-databind-215036598-215111320
FasterXML-jackson-databind-215111320-215799347
FasterXML-jackson-databind-216970075-216985681
HubSpot-Baragon-444834347-445744181
INRIA-spoon-453383968-453477713
INRIA-spoon-454678479-454678770
INRIA-spoon-455704942-455870305
jenkinsci-ansicolor-plugin-440438437-449394834
jgrapht-jgrapht-443997242-444189432
linkedin-pinot-342188288-342446553
molgenis-molgenis-336061452-336065127
molgenis-molgenis-361210220-361993202
molgenis-molgenis-361993202-362486982
molgenis-molgenis-362517584-362989296
molgenis-molgenis-367638811-367645808
molgenis-molgenis-369514407-370006117
OpenFeign-feign-454179734-454278346
openzipkin-zipkin-332209085-332270677
pippo-java-pippo-446336779-446341967
raphw-byte-buddy-352481508-352894244
raphw-byte-buddy-357569370-357575635
raphw-byte-buddy-363589915-364299280
raphw-byte-buddy-432194751-432199042
raphw-byte-buddy-449069943-450332514
smallcreep-cucumber-seeds-442531821-442559338
societe-generale-ci-droid-tasks-consumer-420388707-430936160
SpoonLabs-gumtree-spoon-ast-diff-431628140-431912220
spring-cloud-spring-cloud-gcp-330973656-330980388
spring-projects-spring-data-commons-185852074-193313389
spring-projects-spring-data-commons-193313395-193356189
spring-projects-spring-data-commons-193356189-194423789
spring-projects-spring-data-commons-240714544-241322094
spring-projects-spring-data-commons-254354007-255142407
spring-projects-spring-data-commons-263410130-263513297
spring-projects-spring-data-commons-264284792-264335430
spring-projects-spring-data-commons-271991482-272568125
spring-projects-spring-data-commons-279152312-279418526
spring-projects-spring-data-commons-279460664-280335206
spring-projects-spring-data-commons-286617333-287128429
spring-projects-spring-data-commons-289903133-292475109
spring-projects-spring-data-commons-303079759-303439729
spring-projects-spring-data-commons-323136560-323139345
spring-projects-spring-data-commons-458393275-458823066
spring-projects-spring-data-jpa-341944401-342236799
spring-projects-spring-data-jpa-343344047-343370260
swagger-api-swagger-codegen-331677749-331695545
swagger-api-swagger-codegen-364149464-364892960
vert-x3-vertx-jdbc-client-438227334-440167311
vert-x3-vertx-web-459797171-460136219
webfirmframework-wff-453188520-453188718

@Horeng your workaround makes sense and should yield the same buggy behavior in most of the cases.

have you tried it for all problematic bugs?

@monperrus

@Horeng your workaround makes sense and should yield the same buggy behavior in most of the cases.

have you tried it for all problematic bugs?

TL;DR

I didn't analyze all the failed results, but the workaround can resolve some.
Stat changes

compile results	failures	successes
Initial(Table.1)	103	148
After resolving	43	208

Details

Here I share what I've got for the compiling step.

What I tried to

After I understand how the code from the master branch(c524e43991d43cce5392e2c6b89d24a2ca7e0165) works, I try to compile the 4th commit for each of the bugs.
I've changed the mvn command from mvn install ... to mvn clean package -U ...

I just don't want to install it 😅

Workarounds

1) 4 bugs, Bears-[10-13]

See my comment above: https://github.com/bears-bugs/bears-benchmark/issues/332#issuecomment-1633687807

2) 56 bugs, Bears-[27-82] (Including #334 )

This ranged bugs include #331 , but the build log differed from my result.

Trigger message from build logs

not abstract and does not override abstract method accept(java.nio.file.Path,java.nio.file.attribute.BasicFileAttributes) in org.apache.commons.io.file.PathFilter

Option.1 Use a later version of `commons-io`

In the case of Bears-83, the version of commons-io bumped up from 1.4 to 2.5


diff --git a/pom.xml b/pom.xml
index 09dbdd4ee..f1aee5e37 100644
--- a/pom.xml
+++ b/pom.xml
@@ -244,7 +244,7 @@
 <dependency>
   <groupId>commons-io</groupId>
   <artifactId>commons-io</artifactId>

1.4
2.0
org.apache.commons ```

Option.2 Add a new repository and change the groupId

To keep the version of commons-io:1.4

I prefer this one since it keeps the version of the dependency.


diff --git a/pom.xml b/pom.xml
index 09dbdd4ee..7bfeb8272 100644
--- a/pom.xml
+++ b/pom.xml
@@ -182,6 +182,10 @@
   <name>Maven Repository for Spoon Snapshots</name>
   <url>http://spoon.gforge.inria.fr/repositories/snapshots</url>
 </repository>

fenixedu-maven-repository
https://repo.fenixedu.org/fenixedu-maven-repository
@@ -242,7 +246,7 @@ 1.2.17
commons-io
org.apache.commons commons-io 1.4

Option.3 Refactoring the code

However, this option needs code-level modification.
ref1: https://github.com/eu-emi/canl-java/issues/111
ref2: https://github.com/eu-emi/canl-java/pull/112
ref3: https://github.com/eu-emi/canl-java/pull/112/commits/d1607ac274ccbaaa291e2c933984e12c047d2b68

Not a workaround, but...

21 bugs, Bears-[84-97, 180-185, 244]

For these bugs, the build logs have an Authentication failed for message in the build error logs.
This can be categorized as a dependency missing issue, but it seems hard to find some workarounds.

My environment;

Ubuntu 22.04 LTS, OS name: "linux", version: "5.19.0-46-generic", arch: "amd64", family: "unix"
Java version: 1.8.0_362, vendor: Private Build, runtime: /usr/lib/jvm/java-8-openjdk-amd64/jre
Apache Maven 3.6.3
Python 3.9.0
Default locale: en_US, platform encoding: UTF-8

Table.1 Initial results

BugID       Result  BranchName
Bears-1     success FasterXML-jackson-databind-176912167-190405643
Bears-2     success FasterXML-jackson-databind-190405643-195044059
Bears-3     success FasterXML-jackson-databind-190406891-190505536
Bears-4     success FasterXML-jackson-databind-195066764-195069327
Bears-5     success FasterXML-jackson-databind-195430379-198387397
Bears-6     success FasterXML-jackson-databind-195646489-195752461
Bears-7     success FasterXML-jackson-databind-195752461-195777970
Bears-8     success FasterXML-jackson-databind-203042777-203306015
Bears-9     success FasterXML-jackson-databind-203649003-204682356
Bears-10    failed  FasterXML-jackson-databind-214497429-214500046
Bears-11    failed  FasterXML-jackson-databind-215036598-215111320
Bears-12    failed  FasterXML-jackson-databind-215111320-215799347
Bears-13    failed  FasterXML-jackson-databind-216970075-216985681
Bears-14    success FasterXML-jackson-databind-221825856-221903238
Bears-15    success FasterXML-jackson-databind-223024976-223291136
Bears-16    success FasterXML-jackson-databind-226276279-226639126
Bears-17    success FasterXML-jackson-databind-226654766-226666085
Bears-18    success FasterXML-jackson-databind-226666085-226673064
Bears-19    success FasterXML-jackson-databind-228025083-228873360
Bears-20    success FasterXML-jackson-databind-233857275-234147085
Bears-21    success FasterXML-jackson-databind-241044631-241063530
Bears-22    success FasterXML-jackson-databind-241063530-241065840
Bears-23    success FasterXML-jackson-databind-242268513-242687710
Bears-24    success FasterXML-jackson-databind-243509258-243861380
Bears-25    success FasterXML-jackson-databind-247621332-247674379
Bears-26    success FasterXML-jackson-databind-318458719-318715551
Bears-27    failed  INRIA-spoon-189186902-189233591
Bears-28    failed  INRIA-spoon-189233636-189234660
Bears-29    failed  INRIA-spoon-190241093-190241752
Bears-30    failed  INRIA-spoon-190241752-190558172
Bears-31    failed  INRIA-spoon-191511078-191595944
Bears-32    failed  INRIA-spoon-192604168-192969999
Bears-33    failed  INRIA-spoon-192969999-193004144
Bears-34    failed  INRIA-spoon-193004144-193023299
Bears-35    failed  INRIA-spoon-196963859-196966996
Bears-36    failed  INRIA-spoon-197673696-197674087
Bears-37    failed  INRIA-spoon-197674087-198523383
Bears-38    failed  INRIA-spoon-199972949-199993301
Bears-39    failed  INRIA-spoon-199993301-200108848
Bears-40    failed  INRIA-spoon-201940544-203101555
Bears-41    failed  INRIA-spoon-204567691-207361743
Bears-42    failed  INRIA-spoon-210079209-210080599
Bears-43    failed  INRIA-spoon-211086222-211090498
Bears-44    failed  INRIA-spoon-211090498-211342085
Bears-45    failed  INRIA-spoon-211342085-211425556
Bears-46    failed  INRIA-spoon-213996751-215500998
Bears-47    failed  INRIA-spoon-218213030-221992429
Bears-48    failed  INRIA-spoon-225344336-226528821
Bears-49    failed  INRIA-spoon-227073271-228362442
Bears-50    failed  INRIA-spoon-228371032-228407512
Bears-51    failed  INRIA-spoon-228407512-228634633
Bears-52    failed  INRIA-spoon-228634633-228649848
Bears-53    failed  INRIA-spoon-232723487-232809734
Bears-54    failed  INRIA-spoon-234113323-234113988
Bears-55    failed  INRIA-spoon-234612953-235302726
Bears-56    failed  INRIA-spoon-237078306-237089137
Bears-57    failed  INRIA-spoon-237133219-237187910
Bears-58    failed  INRIA-spoon-237507053-237511642
Bears-59    failed  INRIA-spoon-237627560-237821366
Bears-60    failed  INRIA-spoon-238234811-238235509
Bears-61    failed  INRIA-spoon-239865488-239871875
Bears-62    failed  INRIA-spoon-239871875-239928671
Bears-63    failed  INRIA-spoon-240253890-240366857
Bears-64    failed  INRIA-spoon-240675027-240677764
Bears-65    failed  INRIA-spoon-241091669-241205460
Bears-66    failed  INRIA-spoon-244508852-244943489
Bears-67    failed  INRIA-spoon-245681314-245682273
Bears-68    failed  INRIA-spoon-245682273-245809519
Bears-69    failed  INRIA-spoon-246175274-246195936
Bears-70    failed  INRIA-spoon-246216583-246226768
Bears-71    failed  INRIA-spoon-247837075-247951830
Bears-72    failed  INRIA-spoon-248403517-248678183
Bears-73    failed  INRIA-spoon-249529059-249603843
Bears-74    failed  INRIA-spoon-254745624-256471804
Bears-75    failed  INRIA-spoon-259378726-259664281
Bears-76    failed  INRIA-spoon-259664281-259695141
Bears-77    failed  INRIA-spoon-260087947-260197957
Bears-78    failed  INRIA-spoon-260612138-265581135
Bears-79    failed  INRIA-spoon-270437105-270439051
Bears-80    failed  INRIA-spoon-270439051-271649592
Bears-81    failed  INRIA-spoon-271649592-272084174
Bears-82    failed  INRIA-spoon-272467827-272468614
Bears-83    success INRIA-spoon-277315604-277340707
Bears-84    failed  spring-projects-spring-data-commons-185852074-193313389
Bears-85    failed  spring-projects-spring-data-commons-193313395-193356189
Bears-86    failed  spring-projects-spring-data-commons-193356189-194423789
Bears-87    failed  spring-projects-spring-data-commons-240714544-241322094
Bears-88    failed  spring-projects-spring-data-commons-254354007-255142407
Bears-89    failed  spring-projects-spring-data-commons-263410130-263513297
Bears-90    failed  spring-projects-spring-data-commons-264284792-264335430
Bears-91    failed  spring-projects-spring-data-commons-271991482-272568125
Bears-92    failed  spring-projects-spring-data-commons-279152312-279418526
Bears-93    failed  spring-projects-spring-data-commons-279460664-280335206
Bears-94    failed  spring-projects-spring-data-commons-286617333-287128429
Bears-95    failed  spring-projects-spring-data-commons-289903133-292475109
Bears-96    failed  spring-projects-spring-data-commons-303079759-303439729
Bears-97    failed  spring-projects-spring-data-commons-323136560-323139345
Bears-98    success traccar-traccar-188473748-188474474
Bears-99    success traccar-traccar-190843415-191103948
Bears-100   success traccar-traccar-195128524-195455832
Bears-101   success traccar-traccar-198464113-198488474
Bears-102   success traccar-traccar-201008628-201013389
Bears-103   success traccar-traccar-207561899-207563891
Bears-104   success traccar-traccar-212058933-212061222
Bears-105   success traccar-traccar-216100740-216167822
Bears-106   success traccar-traccar-216189551-216602583
Bears-107   success traccar-traccar-216602583-216605267
Bears-108   success traccar-traccar-219945896-220224837
Bears-109   success traccar-traccar-220525069-220735965
Bears-110   success traccar-traccar-222468469-222479725
Bears-111   success traccar-traccar-222528691-222667430
Bears-112   success traccar-traccar-225874246-226678972
Bears-113   success traccar-traccar-228965242-229298433
Bears-114   success traccar-traccar-233864732-233868407
Bears-115   success traccar-traccar-237845618-237846623
Bears-116   success traccar-traccar-239191142-239340888
Bears-117   success traccar-traccar-241384932-242095240
Bears-118   success traccar-traccar-243199408-243229436
Bears-119   success traccar-traccar-243640798-243870734
Bears-120   success traccar-traccar-248584369-248666173
Bears-121   success traccar-traccar-255051210-255052458
Bears-122   success traccar-traccar-262940348-263330667
Bears-123   success traccar-traccar-265439859-265542197
Bears-124   success traccar-traccar-267146704-267366528
Bears-125   success traccar-traccar-267371558-268530427
Bears-126   success traccar-traccar-269449386-269490884
Bears-127   success traccar-traccar-273118899-273136493
Bears-128   success traccar-traccar-273236004-273269445
Bears-129   success traccar-traccar-274558862-274871026
Bears-130   success traccar-traccar-275432141-275689407
Bears-131   success traccar-traccar-292295467-292405214
Bears-132   success traccar-traccar-301176898-301185806
Bears-133   success traccar-traccar-305623200-305713931
Bears-134   success traccar-traccar-307668730-307760931
Bears-135   success traccar-traccar-308288525-308872339
Bears-136   success traccar-traccar-309459456-309718203
Bears-137   success traccar-traccar-313257147-313260584
Bears-138   success traccar-traccar-316227226-316639485
Bears-139   success traccar-traccar-322427143-322428590
Bears-140   success 2018swecapstone-h2ms-356638992-356666847
Bears-141   success 2018swecapstone-h2ms-363210218-363627522
Bears-142   success Activiti-Activiti-357660134-359342518
Bears-143   success 2018swecapstone-h2ms-369561147-369563262
Bears-144   success aicis-fresco-330883035-330923179
Bears-145   success aicis-fresco-335666803-335692003
Bears-146   success aicis-fresco-363993941-363994940
Bears-147   success aicis-fresco-370467437-370477490
Bears-148   success aicis-fresco-370628089-370634151
Bears-149   failed  apache-incubator-dubbo-329355311-329773929
Bears-150   failed  apache-incubator-dubbo-347256120-347634018
Bears-151   success apache-incubator-dubbo-352635276-352657297
Bears-152   failed  apache-incubator-dubbo-370383941-370422750
Bears-153   success apache-incubator-servicecomb-java-chassis-330826674-331080091
Bears-154   success apache-incubator-servicecomb-java-chassis-371353019-371886679
Bears-155   success apache-jackrabbit-oak-344414751-344705279
Bears-156   success Blazebit-blaze-persistence-351937208-352045689
Bears-157   success CorfuDB-CorfuDB-330246430-330267605
Bears-158   success cpesch-RouteConverter-331125693-331749933
Bears-159   success debezium-debezium-324021438-324040188
Bears-160   success debezium-debezium-324040188-324047191
Bears-161   success debezium-debezium-325431120-326310450
Bears-162   success debezium-debezium-343712961-343714390
Bears-163   success debezium-debezium-351465554-354212780
Bears-164   success debezium-debezium-356786658-357274631
Bears-165   failed  dhis2-dhis2-core-365246679-365386294
Bears-166   success EnMasseProject-enmasse-344863667-344945686
Bears-167   success EnMasseProject-enmasse-344945686-344976598
Bears-168   success EnMasseProject-enmasse-357424637-357457887
Bears-169   success linkedin-pinot-342188288-342446553
Bears-170   failed  molgenis-molgenis-336061452-336065127
Bears-171   failed  molgenis-molgenis-361210220-361993202
Bears-172   failed  molgenis-molgenis-361993202-362486982
Bears-173   failed  molgenis-molgenis-362517584-362989296
Bears-174   failed  molgenis-molgenis-367638811-367645808
Bears-175   failed  molgenis-molgenis-369514407-370006117
Bears-176   failed  openzipkin-zipkin-332209085-332270677
Bears-177   failed  raphw-byte-buddy-352481508-352894244
Bears-178   failed  raphw-byte-buddy-357569370-357575635
Bears-179   failed  raphw-byte-buddy-363589915-364299280
Bears-180   success spring-cloud-spring-cloud-gcp-330973656-330980388
Bears-181   success spring-cloud-spring-cloud-gcp-353059531-353471273
Bears-182   success spring-cloud-spring-cloud-gcp-365341004-365349415
Bears-183   success spring-cloud-spring-cloud-gcp-367417648-367667323
Bears-184   failed  spring-projects-spring-data-jpa-341944401-342236799
Bears-185   failed  spring-projects-spring-data-jpa-343344047-343370260
Bears-186   success swagger-api-swagger-codegen-331677749-331695545
Bears-187   success swagger-api-swagger-codegen-364149464-364892960
Bears-188   success SzFMV2018-Tavasz-AutomatedCar-351742666-351759763
Bears-189   success SzFMV2018-Tavasz-AutomatedCar-367688128-367699437
Bears-190   success thelastpickle-cassandra-reaper-324455111-327555133
Bears-191   success thelastpickle-cassandra-reaper-364710673-365484062
Bears-192   success thelastpickle-cassandra-reaper-365484062-365554427
Bears-193   success Activiti-activiti-cloud-app-service-459060444-459062447
Bears-194   success albfernandez-GDS-PMD-Security-Rules-451155169-455669767
Bears-195   success apache-incubator-dubbo-450828157-450884276
Bears-196   success apache-incubator-tamaya-457807119-461484371
Bears-197   failed  apereo-java-cas-client-408206584-439486928
Bears-198   success aws-aws-encryption-sdk-java-441438164-441901187
Bears-199   success awslabs-amazon-kinesis-client-446289265-452166805
Bears-200   success AxonFramework-AxonFramework-451926440-451937647
Bears-201   success brettwooldridge-HikariCP-446097106-446106182
Bears-202   success classgraph-classgraph-448207270-449613955
Bears-203   failed  cpesch-RouteConverter-432166807-432169636
Bears-204   success CSU-CS414-WareWolves-cs414-f18-001-WareWolves-452444119-454548119
Bears-205   success ctripcorp-apollo-444069339-444288772
Bears-206   success danfickle-openhtmltopdf-445988164-446994292
Bears-207   success DataBiosphere-consent-ontology-453433108-453941362
Bears-208   success debezium-debezium-437012651-437020051
Bears-209   success DmitriiSerikov-money-transfer-service-446104441-446106577
Bears-210   success dungba88-libra-436514153-436524727
Bears-211   success FasterXML-jackson-dataformats-binary-461131167-461139756
Bears-212   success FasterXML-jackson-dataformats-text-430357777-445435582
Bears-213   success hexagonframework-spring-data-ebean-375829425-451220180
Bears-214   failed  HubSpot-Baragon-444834347-445744181
Bears-215   success INRIA-spoon-431373130-431373716
Bears-216   success INRIA-spoon-431601111-431664501
Bears-217   failed  INRIA-spoon-453383968-453477713
Bears-218   failed  INRIA-spoon-454678479-454678770
Bears-219   failed  INRIA-spoon-455704942-455870305
Bears-220   success javadev-underscore-java-435386942-435396295
Bears-221   failed  jenkinsci-ansicolor-plugin-440438437-449394834
Bears-222   success jgrapht-jgrapht-443997242-444189432
Bears-223   success julianps-modelmapper-module-vavr-441307573-461240331
Bears-224   success kmehrunes-valuestreams-438682914-439585987
Bears-225   success lettuce-io-lettuce-core-438538449-438808943
Bears-226   success milaboratory-milib-444855015-444858326
Bears-227   success OpenFeign-feign-454179734-454278346
Bears-228   success openmrs-openmrs-module-htmlformentry-452596787-452623087
Bears-229   success openmrs-openmrs-module-webservices.rest-455565885-458312291
Bears-230   success opentracing-contrib-java-p6spy-390188323-431527545
Bears-231   success org-tigris-jsapar-jsapar-451004011-451741055
Bears-232   success paritytrading-foundation-364820616-448899327
Bears-233   success pippo-java-pippo-446336779-446341967
Bears-234   success rafonsecad-cash-count-435955189-435958219
Bears-235   success rafonsecad-cash-count-435958219-435967865
Bears-236   failed  raphw-byte-buddy-432194751-432199042
Bears-237   failed  raphw-byte-buddy-449069943-450332514
Bears-238   success rkonovalov-jsonignore-442009574-442015798
Bears-239   success shapesecurity-shift-java-455763022-456154969
Bears-240   success smallcreep-cucumber-seeds-442531821-442559338
Bears-241   success societe-generale-ci-droid-tasks-consumer-420388707-430936160
Bears-242   success SonarOpenCommunity-sonar-cxx-437974912-438070185
Bears-243   failed  SpoonLabs-gumtree-spoon-ast-diff-431628140-431912220
Bears-244   failed  spring-projects-spring-data-commons-458393275-458823066
Bears-245   success square-javapoet-418963407-436938143
Bears-246   success thelinmichael-spotify-web-api-java-441742384-442933713
Bears-247   failed  vert-x3-vertx-jdbc-client-438227334-440167311
Bears-248   failed  vert-x3-vertx-web-459797171-460136219
Bears-249   success vitorenesduarte-VCD-java-client-437204853-437571024
Bears-250   success vkostyukov-la4j-414793864-436911083
Bears-251   success webfirmframework-wff-453188520-453188718

Hi @Horeng

thanks a lot for the comprehensive and clear analysis.

it's a great achievement to recover 60 bugs and reach 208 successes! congrats!

the next step would be to prepare new branches with the appropriate workarounds applied to the 4 commits. would you give it a try?

Hi @monperrus

Thank you, and you're welcome 😄

I'll try it even if the progress might slow.

Is there any kind of code of conduct I should follow?

Excellent!

Is there any kind of code of conduct I should follow?

You can fork this repo and push the fixed branches under Horeng/bears-benchmark.

The branch naming convention consists of <oldname>-with-workarounds.

For example, FasterXML-jackson-databind-216970075-216985681 would be FasterXML-jackson-databind-216970075-216985681-with-workarounds

Later we will copy back those fixed branches here and update the metadata.

What do you think?

Hi, @monperrus

You can fork this repo and push the fixed branches under Horeng/bears-benchmark.

The branch naming convention consists of -with-workarounds.

For example, FasterXML-jackson-databind-216970075-216985681 would be FasterXML-jackson-databind-216970075-216985681-with-workarounds

Later we will copy back those fixed branches here and update the metadata.

It is first to me for this kind of task, so I'll follow your suggestion.

While I progress, I'll contact you if I get stuck or need to discuss. 😃

that's great, looking forward to it!

Good day, @monperrus

I finished the task on my forked repository. You can inspect new branches(*-with-workaround) in this link [Horeng/bears-benchmark/branch/active]

What I did;

for each of Bears-[10:13,27:82]

Apply the corresponding workaround.
Validate the bug
- fixed(Commit#4) compilation result should be Success
- fixed(Commit#4) test result should be Success
- buggy(Commit#2 or Commit#1) compilation result should be Success
- buggy(Commit#2 or Commit#1) test result should be Failed
Replace the existing Commit#4 with a workaround applied commit for the valid bugs.
- Update commit message
- Add the workaround

What I should report;

By the validation step above, Bears-[64,67,71] resulted invalid caused of the test result of a fixed version.
- Since specific test cases retrieved from bears.json resulted in failures, I didn't create new branches.
Also, I check the workaround.option#1, but it resulted in failures.

Bears-64

Running spoon.reflect.declaration.CtTypeInformationTest
Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.377 sec <<< FAILURE! - in spoon.reflect.declaration.CtTypeInformationTest
testGetSuperclass(spoon.reflect.declaration.CtTypeInformationTest)  Time elapsed: 0.103 sec  <<< FAILURE!
java.lang.AssertionError: expected:<61> but was:<62>
    at spoon.reflect.declaration.CtTypeInformationTest.testGetSuperclass(CtTypeInformationTest.java:138)

Bears-67

Running spoon.reflect.declaration.CtTypeInformationTest
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.718 sec <<< FAILURE! - in spoon.reflect.declaration.CtTypeInformationTest
testGetSuperclass(spoon.reflect.declaration.CtTypeInformationTest)  Time elapsed: 0.145 sec  <<< FAILURE!
java.lang.AssertionError: expected:<62> but was:<63>
    at spoon.reflect.declaration.CtTypeInformationTest.testGetSuperclass(CtTypeInformationTest.java:144)

Bears-71

Running spoon.reflect.declaration.CtTypeInformationTest
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2.26 sec <<< FAILURE! - in spoon.reflect.declaration.CtTypeInformationTest
testGetSuperclass(spoon.reflect.declaration.CtTypeInformationTest)  Time elapsed: 0.23 sec  <<< FAILURE!
java.lang.AssertionError: expected:<61> but was:<62>
    at spoon.reflect.declaration.CtTypeInformationTest.testGetSuperclass(CtTypeInformationTest.java:140)

Hi @Horeng

Cool!

I'm trying with "FasterXML-jackson-databind-216970075-216985681-with-workaround" and Java 1.8.

I confirm that the top commit is a compilation and test success.

However, the n-1, n-2 and n-3 commits cannot be compiled because of Could not resolve dependencies for project com.fasterxml.jackson.core:jackson-databind:bundle:2.8.8-SNAPSHOT. Is that the same on your side?

Hi @monperrus

However, the n-1, n-2 and n-3 commits cannot be compiled because of Could not resolve dependencies for project com.fasterxml.jackson.core:jackson-databind:bundle:2.8.8-SNAPSHOT. Is that the same on your side?

My bad; I should've applied the workarounds to those commits too. I'll recreate the branches and post them to you.

Hi, @monperrus

I finished the task on my forked repository. You can inspect new branches(*-with-workaround) in this link [Horeng/bears-benchmark/branch/active]

What I did;

for each of Bears-[10:13,27:82]

I just finished recreating the branches with the workarounds again.

Unlike the previous work, I apply the workaround to the buggy commit and rebase the branches.

(To keep the number of commits in 4)

For the bugs, I rechecked and assured the status below;

Bears-[10:13,27:63,65:66,68:70,72:82]

commit_version	compile result	test result
buggy	Success	Don't Care
test	Success	Failed TC existence
fixed	Success	Pass the specific TCs
final	Success	Pass the specific TCs

If you get some other issues for those new branches, then let me know. 😄

Thanks a lot @Horeng I've added FasterXML-jackson-databind-215036598-215111320-with-workaround and FasterXML-jackson-databind-215111320-215799347-with-workaround to the repo, see https://github.com/bears-bugs/bears-benchmark/commit/807053602814522987f201548a678d2e1371ea16

For the two other jackson bugs with workaround, the buggy commit does not fail on my machine.

For the all the Spoon bugs, it's the opposite, the last commit with the fix always fails.

WDYT?

FYI, updated scripts/data/bug_id_and_branch.json with the current 118 valid bugs for Java 8.

You're welcome, @monperrus :)

For the all the Spoon bugs, it's the opposite, the last commit with the fix always fails.

WDYT?

Do you mean the failures of compile on the final commit? or the test results on the final commit?

In the case of compilation, I can still avoid failures(for the Bears-27).

However, if your failure pops up by running scripts/run_tests_bug.py then, I've failed test results too(with 2 failed cases for the Bears-27).

I can pass the test since I ran the tests using the specific test cases(written on the bears.json in each final commit). To do that, I append a test option to the mvn test command on run_tests_bug.py to specify the test cases. Here's an example;

# For Bears-27 (reusing MAVEN_ARGS on run_tests_bug.py)
mvn test $MAVEN_ARGS -Dtest=spoon.test.position.PositionTest#defaultConstructorPositionTest

I mean "the test results on the final commit?".

Yes, we need to run all tests, not only the failing one.

Hi, @monperrus

In that case, I think the leading cause is the replaced dependency, our workarounds, which may have some remaining issues. Unfortunately, I have no idea for the detailed reasons.

bears-bugs / bears-benchmark