gradio-app / gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
http://www.gradio.app
Apache License 2.0
30.37k stars 2.26k forks source link

API recorder broken on several demos #8259

Closed pngwn closed 1 month ago

pngwn commented 1 month ago

Describe the bug

The API recorder seems to work in simple cases but there are quite a few demos where it doesn't work.

Most notably it doesn't work with the ChatInterface.

Have you searched existing issues? 🔎

Reproduction

https://huggingface.co/spaces/gradio/chatinterface_streaming_echo

https://huggingface.co/spaces/gradio/kitchen_sink

Do almost anything and record the requests, and it will break.

What isn't clear to me is how we are supposed to handle the API recorder if certain API requests are essentially 'hidden' from the client. What is more, we don't return info for unnamed routes from /info, so I'm not sure how we are supposed to get hold of this information. We somehow need to workaround these constraints for the API recorder to work.

Screenshot

No response

Logs

No response

System Info

-

Severity

I can work around it

pngwn commented 1 month ago

In terms of what is happening. I'm pretty sure the API recorder works fine but we don't have the information required to build the queries correctly due to the various client changes + how the information to make those changes only applies to certain routes.

freddyaboulton commented 1 month ago

Also see #8246 for another case