adoptium / aqa-test-tools

Home of Test Results Summary Service (TRSS) and PerfNext. These tools are designed to improve our ability to monitor and triage tests at the Adoptium project. The code is generic enough that it is extensible for use by any project that needs to monitor multiple CI servers and aggregate their results.
Apache License 2.0
28 stars 79 forks source link

Chatbot for Efficient Issue Triage and Resolution #808

Open llxia opened 1 year ago

llxia commented 1 year ago

Motivation The current issue triage process often relies on manual analysis and decision-making by developers, which can be time-consuming and error-prone. And the increasing volume and complexity of software issues can overwhelm development teams, leading to delays, inefficiencies, and customer dissatisfaction.

The primary objective of this proposal is to investigate if we can leverage ChatGPT to enhance the issue triage and resolution process.

Possible area of investigation By leveraging the knowledge of ChatGPT, if we can achieve any of the following, that would be great:

The above ideas are just some examples. We are open to any suggestions or recommendations.

https://github.com/adoptium/aqa-test-tools/pull/807 is a simple example, where we provide git issue comments into ChatGPT using llama_index, then the user can ask questions. To run it, start with https://github.com/adoptium/aqa-test-tools/blob/master/Chatbot/myKeys.sh

The cost of ChatGPT can vary depending on the specific implementation and usage requirements. It is one of the risk factors that we should keep in mind.