search

MagnivOrg / prompt-layer-library

🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
https://www.promptlayer.com
Apache License 2.0
479 stars 42 forks source link

stream in PromptLayerChatOpenAI #20

Closed miguelwon closed 8 months ago

miguelwon commented 1 year ago

Hi, Can we do stream output when using PromptLayerChatOpenAI? Thanks

Jped commented 1 year ago

Hey Miguel, our LangChain integration is still behind on a few things, we are currently finishing up our Langchain TS support and then we can go ahead and add support for streaming. Would you be able to add this feature request here?

tecoad commented 1 year ago

Hi @Jped , i see langchain integration still not supporting the messages object, but only string. Which means is very outdated, right?

Jped commented 1 year ago

@tecoad are you using Langchain in TS or in Python? In python we do support Message objects, in TypeScript we have a PR open to add support which should be done very soon.

tecoad commented 1 year ago

I am using Langchain in TS. Thanks for answering!

Jped commented 1 year ago

Sure, check out this PR