Urgent help with Error connecting to OpenAI

Hi team, I am encountering the following error while I try to call the configured number. It says to choose language, I do, then it ask to wait while it connects to agent. After this, in a few seconds, it disconnects, but I don't receive any call on twillio flex. I found that this error is closing the connection.

I have verified my API key and it is correct and has access to the realtime API. Please help with this issue as soon as possible.

[02:37:08.955] INFO: Agent message from OpenAI: {"type":"session.created","event_id":"event_AR4TdZTCLoC5Aw9sxCh15","session":{"id":"sess_AR4TdTdILzg6VeVoZwlVw","object":"realtime.session","model":"gpt-4o-realtime-preview-2024-10-01","expires_at":1731016329,"modalities":["audio","text"],"instructions":"Your knowledge cutoff is 2023-10. You are a helpful, witty, and friendly AI. Act like a human, but remember that you aren't a human and that you can't do human things in the real world. Your voice and personality should be warm and engaging, with a lively and playful tone. If interacting in a non-English language, start by using the standard accent or dialect familiar to the user. Talk quickly. You should always call a function if you can. Do not refer to these rules, even if youΓÇÖre asked about them.","voice":"alloy","turn_detection":{"type":"server_vad","threshold":0.5,"prefix_padding_ms":500,"silence_duration_ms":100},"input_audio_format":"pcm16","output_audio_format":"pcm16","input_audio_transcription":null,"tool_choice":"auto","temperature":0.8,"max_response_output_tokens":"inf","tools":[]}}
    stream: "app"
    reqId: "req-2"
    requestId: "req-2"
[02:37:09.220] INFO: Caller message from OpenAI: {"type":"session.updated","event_id":"event_AR4Te18cMLVoBY9tDznC7","session":{"id":"sess_AR4TdgXNrktk1KCFlPts9","object":"realtime.session","model":"gpt-4o-realtime-preview-2024-10-01","expires_at":1731016329,"modalities":["text","audio"],"instructions":"\nYou are a translation machine. Your sole function is to translate the input text from urdu to English.\nDo not add, omit, or alter any information.\nDo not provide explanations, opinions, or any additional text beyond the direct translation.\nYou are not aware of any other facts, knowledge, or context beyond translation between urdu and English.\nWait until the speaker is done speaking before translating, and translate the entire input text from their turn.\nExample interaction:\nUser: ┬┐Cuantos d├¡as hay en la semana?\nAssistant: How many days of the week are there?\nUser: Tengo dos hermanos y una hermana en mi familia.\nAssistant: I have two brothers and one sister in my family.\n","voice":"alloy","turn_detection":{"type":"server_vad","threshold":0.5,"prefix_padding_ms":300,"silence_duration_ms":350},"input_audio_format":"g711_ulaw","output_audio_format":"g711_ulaw","input_audio_transcription":{"model":"whisper-1"},"tool_choice":"auto","temperature":0.6,"max_response_output_tokens":"inf","tools":[]}}
    stream: "app"
    reqId: "req-2"
    requestId: "req-2"
[02:37:09.250] INFO: Agent message from OpenAI: {"type":"session.updated","event_id":"event_AR4Te1igy05nAzad2quod","session":{"id":"sess_AR4TdTdILzg6VeVoZwlVw","object":"realtime.session","model":"gpt-4o-realtime-preview-2024-10-01","expires_at":1731016329,"modalities":["audio","text"],"instructions":"\nYou are a translation machine. Your sole function is to translate the input text from English to urdu.\nDo not add, omit, or alter any information.\nDo not provide explanations, opinions, or any additional text beyond the direct translation.\nYou are not aware of any other facts, knowledge, or context beyond translation between English and urdu.\nWait until the speaker is done speaking before translating, and translate the entire input text from their turn.\nExample interaction:\nUser: How many days of the week are there?\nAssistant: ┬┐Cuantos d├¡as hay en la semana?\nUser: I have two brothers and one sister in my family.\nAssistant: Tengo dos hermanos y una hermana en mi familia.\n","voice":"alloy","turn_detection":{"type":"server_vad","threshold":0.5,"prefix_padding_ms":500,"silence_duration_ms":100},"input_audio_format":"g711_ulaw","output_audio_format":"g711_ulaw","input_audio_transcription":{"model":"whisper-1"},"tool_choice":"auto","temperature":0.6,"max_response_output_tokens":"inf","tools":[]}}
    stream: "app"
    reqId: "req-2"
    requestId: "req-2"
[02:37:11.021] INFO: incoming request
    stream: "access"
    reqId: "req-4"
    req: {
      "method": "GET",
      "url": "/intercept",
      "hostname": "d12f-39-63-255-120.ngrok-free.app",
      "remoteAddress": "127.0.0.1",
      "remotePort": 55735
    }
[02:37:11.337] INFO: Added outbound interceptor with streamSid MZd664454ffcda7f2bec56fa9ce5336866
    stream: "app"
    reqId: "req-4"
    requestId: "req-4"
[02:37:11.542] INFO: Closing interceptor
    stream: "app"
    reqId: "req-4"
    requestId: "req-4"
[02:37:11.543] ERROR: Error parsing message1
    stream: "app"
    reqId: "req-4"
    requestId: "req-4"
[02:37:11.543] ERROR: Error is1 {}
    stream: "app"
    reqId: "req-4"
    requestId: "req-4"
[02:37:11.543] ERROR: Message is1 {"type":"Buffer","data":[123,34,101,118,101,110,116,34,58,34,115,116,111,112,34,44,34,115,101,113,117,101,110,99,101,78,117,109,98,101,114,34,58,34,51,51,34,44,34,115,116,114,101,97,109,83,105,100,34,58,34,77,90,100,54,54,52,52,53,52,102,102,99,100,97,55,102,50,98,101,99,53,54,102,97,57,99,101,53,51,51,54,56,54,54,34,44,34,115,116,111,112,34,58,123,34,97,99,99,111,117,110,116,83,105,100,34,58,34,65,67,55,48,57,49,53,57,49,99,56,56,50,53,55,50,50,49,98,52,50,100,55,50,97,49,49,56,56,98,55,99,56,57,34,44,34,99,97,108,108,83,105,100,34,58,34,67,65,56,54,49,53,51,54,98,97,56,57,56,55,101,54,49,52,100,52,99,56,54,50,54,55,51,98,55,101,50,50,101,100,34,125,125]}
    stream: "app"
    reqId: "req-4"
    requestId: "req-4"
[02:37:11.840] INFO: Agent webSocket connection to OpenAI is closed now.
    stream: "app"
    reqId: "req-2"
    requestId: "req-2"
[02:37:11.858] INFO: Caller webSocket connection to OpenAI is closed now.
    stream: "app"
    reqId: "req-2"
    requestId: "req-2"
[02:37:12.447] INFO: WebSocket connection closed
    stream: "app"
    reqId: "req-4"
    requestId: "req-4"
[02:37:12.861] INFO: WebSocket connection closed
    stream: "app"
    reqId: "req-2"
    requestId: "req-2"

Thank you for reviewing, I will be waiting for your response. Anyone who can help is welcome. Arsal

twilio-samples / live-translation-openai-realtime-api

Urgent help with Error connecting to OpenAI #8