This is a fork of the official OpenAI Node.js library that has been adapted to support the Azure OpenAI API. The objective of this library is to minimize the changes required to migrate from the official OpenAI library to Azure OpenAI or revert back to OpenAI.
When talking to my Azure deployment and using streaming mode, I've found that the tokens being returned are out of order. They're all there, just not in the right sequence. Is this a known issue? Here's my code, though it's unremarkable and largely follows the OAI cookbook:
When talking to my Azure deployment and using streaming mode, I've found that the tokens being returned are out of order. They're all there, just not in the right sequence. Is this a known issue? Here's my code, though it's unremarkable and largely follows the OAI cookbook:
Sample output of the console from the above: