Timeout on longer generations: Part 1

[0ptim]

Because fly.io has a 60-second idle timeout, some questions fail. After 60 seconds, fly.io just returns an HTTP 500 error.

https://community.fly.io/t/60-second-timeout-for-http-server/1243

Solution

Instead of using HTTP Rest, we'll be using a web socket to

• Keep the connection open at all time
  • No idle timeout from fly.io (yay 🎉)