Closed arthurscchan closed 2 months ago
This PR relates to #507 and continue to modify, adds, removes and fixes the benchmark yaml files in the jvm-all benchmark set for JVM projects. The end goal is to have better coverage gain result shown by the benchmark.
/gcbrun exp -n ascc-jvm-pr-516-1 -m vertex_ai_gemini-1-5 -b jvm-all
/gcbrun exp -n ascc-jvm-pr-516-2 -m vertex_ai_gemini-1-5 -b jvm-all
/gcbrun exp -n ascc-jvm-pr-516-3 -m vertex_ai_gemini-1-5 -b jvm-all
Experiment looks good: https://llm-exp.oss-fuzz.com/Result-reports/ofg-pr/2024-08-01-516-ascc-jvm-pr-516-3-jvm-all/index.html
This PR relates to #507 and continue to modify, adds, removes and fixes the benchmark yaml files in the jvm-all benchmark set for JVM projects. The end goal is to have better coverage gain result shown by the benchmark.