search

smol-ai / developer

the first library to let you embed a developer agent in your own app!
https://twitter.com/SmolModels
MIT License
11.8k stars 1.03k forks source link

how to run with gpt3.5 #25

Open m0zzaR opened 1 year ago

m0zzaR commented 1 year ago

i have access to gpt4 but i'd rather not use it as I could imagine smol-developer, especially in its early development stage, would use a lot of token's and make many requests to ChatGPT.

I am trying to run this command:

modal run main.py --prompt prompt.md --model=gpt-3.5

I am also running into the issue where even if I do run it normally with:

modal run main.py --prompt prompt.md

It gives me this error:

InvalidRequestError: The model: `gpt-4` does not exist

Yes, I have access to GPT4 aswell as paid rate usage and yes I have access to the modal library. Does anyone know of a place within the smol-developer repository where i can change the model to gpt3.5?

m0zzaR commented 1 year ago

Update: sorry, all i had to do was update the 'openai_model' variable to 'gpt-3.5-turbo' in main.py, and it generated a program. I thought id just leave this issue here for anyone else that runs into the same problem.

Nonetheless I still cannot use smol-developer with gpt4, any ideas why?

beingforthebenefit commented 1 year ago

I have the same issue. "gpt-4 does not exist". I have a credit card on file for the API and have ChatGPT Plus with access to ChatGPT 4. I even recreated the API key after upgrading to ChatGPT Plus. Still, I'm reduced to using gpt-3.5-turbo.

hjdesulme commented 1 year ago

Someone correct me if I'm wrong, but I believe that having access to GPT-4 via ChatGPT Plus is not the same as having API access to the gpt-4 model. In order to get API access, you must join the GPT-4 API waitlist.

beingforthebenefit commented 1 year ago

@hjdesulme You are absolutely correct. Thank you for the link--I'm now on the waitlist

swyxio commented 1 year ago

yes - there's a waitlist. the official way to get off the waitlist is to contribute something to https://github.com/openai/evals/

i may actually open up a smol.ai api path just for testing, with some rate limits, so that y'all can test it out properly since GPT4 is so much better at code gen. TODO list for me

sgdesmet commented 1 year ago

Fyi the prompt to generate the files paths didn't work for me with gpt3.5-turbo: despite instructions,the generated text looked something like this:

Possible list of filepaths:

  • ./welcome-message.csv: CSV file containing the welcome message to send to each user.
  • ./user-list.csv: CSV file containing the list of users to send the welcome message to.