search

SamiaKabir / ChatGPT-Answers-to-SO-questions

9 stars 4 forks source link

Performance of different ChatGPT versions #1

Open coxep opened 9 months ago

coxep commented 9 months ago

Different versions of chatgpt perform differently to questions such as these. I have glanced over the preprint for the accompanying paper and did not see version information included in the abstract or introduction. Did I miss that, or was it omitted? Could you clarify the version that was used?

SamiaKabir commented 9 months ago

Thank you for reaching out. We have used GPT-3.5 (the free version of ChatGPT chat-interface) for acquiring ChatGPT responses for our manual analysis. You can find more details in Section 3.1.2 of the pre-print paper.

On Tue, Aug 15, 2023 at 8:01 AM Eric Cox @.***> wrote:

Different versions of chatgpt perform differently to questions such as these. I have glanced over the preprint for the accompanying paper and did not see version information included in the abstract or introduction. Did I miss that, or was it omitted? Could you clarify the version that was used?

— Reply to this email directly, view it on GitHub https://github.com/SamiaKabir/ChatGPT-Answers-to-SO-questions/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIN54E5NKN75VZGEKBAZBALXVNQLPANCNFSM6AAAAAA3Q7CCG4 . You are receiving this because you are subscribed to this thread.Message ID: @.***>

--

Samia Kabir, Ph.D. Student Department of Computer Science Purdue University West Lafayette, IN 47906 *Email: @., @.

coxep commented 9 months ago

Thank you. Do you have any plans to follow up with performance of ChatGPT 4?

stevenjfr commented 2 months ago

@coxep I'm going to look at performance of ChatGPT4 as part of a research project this year. If you have any particular aims you're interested in (or @SamiaKabir too!) let me know and I can try and incorporate this!