Live queries fail when using Redis in cluster mode

[ddribeiro]

Fleet version: 4.57

---

💥  Actual behavior

When live querying more than a handful of hosts in v4.57.0 in an environment using Redis clusters, Fleet either:

• Hangs and never returns results (stuck on 0% of hosts responded)
• Hosts respond and say Your live query returned no results.

Fleet server logs show:

err: load active queries: load cache: get query sql: MOVED 10647 <redacted_redis_url>:6379
   level: error
   op: QueriesForHost
   ts: 2024-10-09T16:04:27.986537016Z 

🧑‍💻  Steps to reproduce

1. In an environment with Redis clusters enabled, run a live query against 5+ hosts.
2. Observe either behavior mentioned in the above section.

🕯️ More info (optional)

N/A

[JoStableford]

Linked to Unthread ticket:

Issues with realtime queries on v4.57.0 #3208)

[ddribeiro]

Internal engineering thread discussing this issue

[sharon-fdm]

Hey team! Please add your planning poker estimate with Zenhub @iansltx @mostlikelee @lucasmrod