mikeizbicki / modulus-magnus-linguae

8 stars 6 forks source link

Advice on Prompt Engineering #9

Open sophiahuangg opened 1 year ago

sophiahuangg commented 1 year ago

Hi Mike,

I'm trying to use the OpenAI API for task 1, but I keep hitting an openai.error.RateLimitError: You exceeded your current quota, please check your plan and billing details. error. My assumption is because we need to pay to use the API.

I wasn't sure if you had a different method in mind for figuring out how to prompt the language models/I'm approaching this the wrong way or if it seems reasonable to use the OpenAI API for this task?

mikeizbicki commented 1 year ago

Hmm... OpenAI is showing me that we have currently only used $0.07 worth of queries. So billing shouldn't be an issue and the problem is likely something else.

To get unstuck, you can try creating your own account on openai with a trial plan. Then setup your own instance of the lmql service or use the public playground with your own key.

alysawyer commented 1 year ago

the trial account doesn't work without putting in a credit card -- do you know any work arounds?

mikeizbicki commented 1 year ago

You can find my lmql config file (which contains the openai api key) at /home/mizbicki/.lmql/api.env on the lambda server. Feel free to use it for whatever you'd like.

(I suggested creating your own API key because I didn't want to paste my API key into github, since then bots that trawl github for API keys would find it and start charging an obscene bill. And it didn't occur to me last night that I could just direct you to the file on the lambda server that contains the API key.)

alysawyer commented 1 year ago

Got it -- thanks!