search

nerc-project / operations

Issues related to the operation of the NERC OpenShift environment
2 stars 0 forks source link

bug: Connection to the Kruize GPU project on test-2.nerc not possible #670

Closed schwesig closed 3 months ago

schwesig commented 3 months ago

Connection to the Kruize GPU Project on test-2.nerc not possible

Description:

Since approximately 1am ET today, the connection to the Kruize GPU project on test-2.nerc is not possible. The issue was confirmed by team members from Kruize and @schwesig. The connection was working at least until 3pm ET yesterday (Thursday).

Error Message Chrome https://console-openshift-console.apps.nerc-ocp-test-2.nerc.mghpcc.org/

This site can’t be reached
console-openshift-console.apps.nerc-ocp-test-2.nerc.mghpcc.org’s
server IP address could not be found.

Steps to Reproduce:

  1. Attempt to connect to the Kruize GPU project on test-2.nerc.

Expected Behavior:

The connection to the Kruize GPU project on test-2.nerc should be successful.

Additional Information:

URL: OpenShift Console

Environment:

/CC @tssala23 @dystewart @larsks @computate @hpdempsey @jtriley /CC @shekhar316 @rebeccaSimmonds19

schwesig commented 3 months ago

Feedback from the team. "Yes, it was working for me at night as well. Saad has also confirmed that it was working for him in the morning (IST)."

schwesig commented 3 months ago

ping https://console-openshift-console.apps.nerc-ocp-test-2.nerc.mghpcc.org ping: https://console-openshift-console.apps.nerc-ocp-test-2.nerc.mghpcc.org: Name or service not known

test against other cluster ping https://console-openshift-console.apps.obs.nerc.mghpcc.org
PING https\058\047\047console-openshift-console.apps.obs.nerc.mghpcc.org (1x9.xx.xx.8) 56(84) bytes of data.

schwesig commented 3 months ago

thanks @tssala23 !!

It is a DNS issue here a quick workaround: add the following to your /etc/hosts file

128.31.20.90    api.nerc-ocp-test-2.nerc.mghpcc.org
128.31.20.112   console-openshift-console.apps.nerc-ocp-test-2.nerc.mghpcc.org
128.31.20.112   oauth-openshift.apps.nerc-ocp-test-2.nerc.mghpcc.org
schwesig commented 3 months ago

@tssala23 do we need to add Justin to this issue?

tssala23 commented 3 months ago

@schwesig I already asked him on this issue https://github.com/nerc-project/operations/issues/622#issuecomment-2264047565

jtriley commented 3 months ago

Should be resolved now. Please reopen if you still have issues.

schwesig commented 3 months ago

Thanks @jtriley @tssala23 🙏