Open NightMachinery opened 5 months ago
I think it was changed to messages now, and to send a traditional prompt, you send it with the "system" role:
from openai import OpenAI client = OpenAI()
completion = client.chat.completions.create( model="gpt-3.5-turbo", messages=[ {"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "Hello!"} ] )
The site has this example code for sending ChatML messages:
But I can't find how I can send a simple
prompt
(with no instruct formatting) in Python and get the response streamed.Related: