search

hashicorp / nomad

Nomad is an easy-to-use, flexible, and performant workload orchestrator that can deploy a mix of microservice, batch, containerized, and non-containerized applications. Nomad is easy to operate and scale and has native Consul and Vault integrations.
https://www.nomadproject.io/
Other
14.57k stars 1.92k forks source link

UI: job index page fails in federated cluster with one region < 1.8.0 #23497

Open Alexsandr-Random opened 6 days ago

Alexsandr-Random commented 6 days ago

Nomad version

Nomad v1.7.7 BuildDate 2024-04-16T19:26:43Z Revision 0f34c85ee63f6472bd2db1e2487611f4b176c70c

Nomad v1.8.1 BuildDate 2024-06-19T06:43:57Z Revision 5022543e4b7b8dcec9df123f86630ae3fdcffbe6

Operating system and Environment details

ubuntu 22.04

Issue

In UI you can't see any jobs when you have federation when global side (main) is upgraded and other side is not (v.1.7.7)

Reproduction steps

Setup federation cluster make major region upgrade minor region should be v1.7.+ version try to login into minor region via UI - you can't! you can't see any jobs. you could see clients and jobs inside it, but it sound like bug. and you will be prompted with error 'rpc: can't find method Job.Statuses' this indicates broken backward compatibility between 2 major releases, although you state that it always exists.

Expected Result

you could see jobs in minor cluster without upgrade to latest version

Actual Result

you can't - only if you upgrades to major region version

Nomad Server logs (if appropriate)

nomad.rpc: RPC error: error="rpc: can't find method Job.Statuses" connection="&{260904 262062 7 0xc001970180 3 {0 0} 0xc002863980 {0 0} [0 1 0 2 0 0 0 7 0 0 0 0] 0xc0039004e0 {0 0} [0 0 0 0 0 0 0 7 0 0 0 82] 0xc003900540 {0 0} 0xc0016b2480 0xc0016b24e0 {{0 0 }} 0xc0016b2540 }"

tgross commented 6 days ago

Hi @Alexsandr-Random! That's certainly an issue, although one that probably can't be easily fixed at the RPC level because the older server simply doesn't have that RPC. I'll mark this for roadmapping.

Alexsandr-Random commented 6 days ago

@tgross This is the fastest response to the issue I've ever seen