Stream True: 'generator' object does not support item assignment

DevXT-LLC / ezlocalai

ezlocalai is an easy to set up local artificial intelligence server with OpenAI Style Endpoints.

MIT License

66 stars 12 forks source link

Stream True: 'generator' object does not support item assignment #19

Closed mohit67890 closed 4 months ago

mohit67890 commented 5 months ago

Hi,

If I try the chat completions with stream = True, it gives me an error 'generator' object does not support item assignment. I think this is part of the generate function of LLM.py

Any idea how I can deal with Stream = True

Regards, Mohit

Josh-XT commented 5 months ago

Hello, could you show the full error please? Thank you!