The current bottleneck in the streaming pipeline comes from the background thread syncing with TanStack query. We could get rid of the background thread for fetching data in batches for TanStack query with a socket.io client querying NextJS endpoint that serve from a Socket.io server.
We would have to figure out how to share the HTTP session between the NextJS server and the socket.io server
Description
The current bottleneck in the streaming pipeline comes from the background thread syncing with TanStack query. We could get rid of the background thread for fetching data in batches for TanStack query with a socket.io client querying NextJS endpoint that serve from a Socket.io server.
We would have to figure out how to share the HTTP session between the NextJS server and the socket.io server
Motivation
No response
Change
No response
Additional Information