shreyashankar / gpt3-sandbox

The goal of this project is to enable users to create cool web demos using the newly released OpenAI GPT-3 API with just a few lines of Python.
MIT License
2.9k stars 884 forks source link

Do I need to prime the model everytime I make a request to it ? #79

Closed rushilchugh01 closed 3 years ago

rushilchugh01 commented 3 years ago

Like, every single time I want to get something from the model, do I need to give it examples ?

On is it possible I create pretext/profile/save the examples someplace such that I do not have to send it to the model everytime I make a request ?

Upon making a request would the examples I try and train it with prior eat up the tokens as well ?

Just a question, couldn't think of a better forum to ask. Please close if you don't find it appropriate.

Thanks.

shreyashankar commented 3 years ago

I don't think you are required to give it examples, but any time you make a request, your credits are used based on how many tokens are in the response.