I seems the huggingface pipeline does not support streaming out of the box.
While it certainly will be possible to implement this, it might be too much effort for a simple web demo. Therefore, I reset the status of the web demo to just show Awaiting Response and then print everything at once.
I seems the huggingface pipeline does not support streaming out of the box. While it certainly will be possible to implement this, it might be too much effort for a simple web demo. Therefore, I reset the status of the web demo to just show Awaiting Response and then print everything at once.