ChatGPT GitHub Action for gene-associated modification

[feiranl]

Description of the issue:

We are thinking that we can make ChatGPT as github action so that it can double check the modification made in the pull request.

1) Go to Uniprot extract the annotation for the modified gene 2) check wether the gene is associated with the subsystem and the substrates 3) according to the output, then define pass/fail for the model modification

[mihai-sysbio]

Some more clarifications would be appreciated:

• What is a modified gene? A gene entry in the yaml that was added in that PR?
• What is implied by "go to UniProt"?
• How does one check whether a gene is associated with the system and substrates? Just ask ChatGTP?

[mihai-sysbio]

Here is a random example with ChatGTP:

And here is another one from the OpenAI API:

[mihai-sysbio]

And here is the Bing answer to the same question (balanced version):

and the more precise answer:

[feiranl]

@guozhetao Could you handle this task?

[mihai-sysbio]

In my previous tests with publicly-available AI models, the responses I would get were not trustworthy. I'd be curious to see how this changed since, and perhaps if the question can be formulated differently for a more accurate answer.

[feiranl]

Yes, it seems much better right now with the development of LLMs. Will update soon.