search

ajndkr / lanarky

The web framework for building LLM microservices
https://lanarky.ajndkr.com/
MIT License
975 stars 74 forks source link

Issue with second message #3

Closed rogalvil closed 1 year ago

rogalvil commented 1 year ago

I was testing it and the first message worked correctly but if I make a second request it shows the following error.

Captura de pantalla 2023-04-21 a la(s) 17 55 23

haixinglps commented 1 year ago

我这里也遇到这问题。我用的python3.8环境。3.9不清楚

ajndkr commented 1 year ago

Hi @rogalvil, I was able to reproduce the issue on my end. Likely a bug in AsyncFastApiStreamingCallback. Looking into it.

ajndkr commented 1 year ago

Hi @haixinglps, this package supports python 3.9+ at the moment. You can use a conda virtual environment for this.

ajndkr commented 1 year ago

@rogalvil I've pushed a fix and made a new release. Please re-install the package: pip install fastapi-async-langchain==0.1.1 and try again. Let me know if you face any issues.

haixinglps commented 1 year ago

Hi @haixinglps, this package supports python 3.9+ at the moment. You can use a conda virtual environment for this.

ok

rogalvil commented 1 year ago

@ajndkr Thank you very much, now it works for me.