search

mikeizbicki / modulus-magnus-linguae

8 stars 6 forks source link

gpt-4 access? #60

Open alysawyer opened 1 year ago

alysawyer commented 1 year ago

Hi! I'm kind of intrigued by TinyStories: How Small Can Language Models Be and Still Speak Coherent English?'s method that Textbooks Are All You Need used where they had gpt-4 grade the generative answers.

I don't think that it would be as effective in our paper because I assume it has much less Latin knowledge than coding knowledge but I want to see if it would be possible since I think that there is some potential to modify the scoring prompting that could work (?) like including the chapter of the textbook in the prompt.

Thus, I was wondering if I could get access to gpt-4 to do some experiments if you think that this route could make sense.

mikeizbicki commented 1 year ago

OpenAI recently announced that GPT-4 is available for everyone: https://openai.com/blog/gpt-4-api-general-availability so you should have access.

I think there's definitely some reasonable experiments to do that use GPT-4. From a practical standpoint, I've heard people talking about the interface to GPT-4 being really slow and unreliable, but I've not actually used it, so I don't know.

alysawyer commented 1 year ago

ok thank you! I will give it a go and let you know about how it turns out