search

Future-House / paper-qa

High accuracy RAG for answering questions from scientific documents with citations
Apache License 2.0
6.44k stars 618 forks source link

`router_cooldown_event_callback but _deployment is None for deployment_id=...` error #574

Open Litreviewing opened 1 month ago

Litreviewing commented 1 month ago

I am getting this error when running a query : Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.

in router_cooldown_event_callback but _deployment is None for deployment_id=81388564bb5ba0d80f710f39aea9f71baec4b680b19885ea00285e9362f63918. Doing nothing

jamesbraza commented 1 month ago

Hi @Litreviewing yep I have hit this too, it's an outstanding bug in our upstream dependency litellm: https://github.com/BerriAI/litellm/issues/5933

It's why we added the ability to bypass the litellm.Router in https://github.com/Future-House/paper-qa/pull/563

This is sort of an area of active development, so we don't have docs on it yet

Litreviewing commented 1 month ago

Hey @jamesbraza ,

Got it, also is there a way to change the settings such that it can conduct a literature review? I tried changing the config files to add longer length answers but still getting short summary responses.

Additionally, is there a way to change the citation format? I've noticed it can inaccurately cite a document, so even if it's able to cite the filename at least from there I can manually adjust.

Thanks!