search

ASSERT-KTH / sorald

Automatic repair system for static analysis warnings from SonarQube's SonarJava, TDSC 2022 http://arxiv.org/pdf/2103.12033
MIT License
90 stars 27 forks source link

Crashes in benchmarking #405

Open slarse opened 3 years ago

slarse commented 3 years ago

I'm working on my benchmark script (which turned out to be a bit more intricate than I had planned), and found a few projects with crashes when repairing with processor 1854

https://github.com/geosolutions-it/imageio-ext.git@a92a9daeb565840d8c709c45fdbf986250f76e43
https://github.com/Waikato/moa.git@f1f147a73478cbde0ae7eb00889e1cc83ab42b06
https://github.com/GlenKPeterson/Paguro.git@de98375df2dd9c26a8cb618d51862f52c64602af
https://github.com/ppiastucki/recast4j.git@fe90d24e2208db61293d72dddfe6df0fbb9a3dfa
https://github.com/weibocom/motan.git@39487e161322e349b2e6da155cb9fd6598eabfc8
https://github.com/ChargeTimeEU/Java-OCA-OCPP.git@9ce7411ec2a9e08103cb28d204a00582071eab5c
https://github.com/davidmoten/rxjava2-extras.git@0d8e7e5cad69fcb6b9667e48e2cb2d0c90b80813

I haven't looked into the actual crashes yet, but Sorald fails to produce output.

slarse commented 3 years ago

@khaes-kth This seems to mostly correspond with the unfixed problems in #337 , would you agree? Are there any failing projects here that you don't recognize?

khaes-kth commented 3 years ago

@slarse We get some errors on 7 projects:

vertx-service-proxy
Java-OCA-OCPP
recast4j
light-rest-4j
moa
imageio-ext
openpnp

We decided to ignore these projects for now.

PS: Note that we do not consider 1854 for our experiment.

slarse commented 3 years ago

Right, so most of the projects are recurring. Your set additionally contains openpnp and vertx-service-proxy, while my set additionally contains Paguro, motan and rxjava2-extras.

khaes-kth commented 3 years ago

Yeah, I also noticed that most of these 7 projects crash on more than 1 rules.