google / oss-fuzz-gen

LLM powered fuzzing via OSS-Fuzz.
Apache License 2.0
841 stars 98 forks source link

Display triage prompt on web (#538) #546

Closed DonggeLiu closed 1 month ago

DonggeLiu commented 1 month ago

From #538: This PR displays the triage prompt on the web, making it easier to read and evaluate the factors affecting LLM triage.

DonggeLiu commented 1 month ago

/gcbrun exp -n my

DavidKorczynski commented 1 month ago

I think this was only for running an experiment and not to be merged -- the changes were merged here: https://github.com/google/oss-fuzz-gen/pull/538/files

DavidKorczynski commented 1 month ago

Closing this as it's already merged in -- however, I'm not sure the UI is displaying what's in intended when looking at https://llm-exp.oss-fuzz.com/Result-reports/ofg-pr/2024-08-19-546-my-comparison/index.html

DavidKorczynski commented 1 month ago

however, I'm not sure the UI is displaying what's in intended when looking at https://llm-exp.oss-fuzz.com/Result-reports/ofg-pr/2024-08-19-546-my-comparison/index.html

This is wrong -- looking at it deeper it looks like the triage display is working as intended!

mihaimaruseac commented 1 month ago

It is not on the main branch. #538 was merging from one feature branch to another.

But that being said, I'd leave it to you/Dongge to decide if this should go on main branch or not.

DavidKorczynski commented 1 month ago

But that being said, I'd leave it to you/Dongge to decide if this should go on main branch or not.

Ah! Good catch! I'll reopen in that case

DavidKorczynski commented 1 month ago

Experiment is looking good

DavidKorczynski commented 1 month ago

/gcbrun skip

DonggeLiu commented 1 month ago

Yep, thanks both @DavidKorczynski @mihaimaruseac This is mainly because @fdt622 does not access to run experiments on PRs, so I am running a final test experiment here before merging.

Does everything look good to you @fdt622 ? If so we can merge this now.

fdt622 commented 1 month ago

Yep, thanks both @DavidKorczynski @mihaimaruseac This is mainly because @fdt622 does not access to run experiments on PRs, so I am running a final test experiment here before merging.

Does everything look good to you @fdt622 ? If so we can merge this now.

Thank you all. So far, the results look good.

mihaimaruseac commented 1 month ago

In this case, let's merge it. Thank you, everyone!