Closed chenxiaolong-coder closed 1 year ago
Hello,
Can you explain what the typewriter effect is?
In this case, the gateway is just a load balancer before all the replicas of the Deployment, so no caching or logic is applied there.
What is the expected behavior here?
If you do not need this because you do not want the Replication, you can disable the load balancer by having the include_gateway=False
Taking a look at the two diagrams above, the expectation is that the first diagram will have the effect of presenting the data to the client in real time as a stream, rather than caching it to a certain size and then sending it to the client
Okey, will take a look once I am back from holiday.
Part of the team is out and we will look at it ASAP.
For now, if you do not need the replication, you can disable the gateway by passing the argument to False.
Hey @chenxiaolong-coder ,
this has been solved in the latest patch release.
https://github.com/jina-ai/jina/releases/tag/v3.20.1
Please, you can give it a try
Describe the bug
I found that the gateway caches the data to a certain size before sending it to the client, which can cause the typewriter effect to fail Describe how you solve it
Environment
A screenshot of a wireshark packet capture with the parameter include_gateway set to False is as follows:
the parameter include_gateway set to True is as follows