Users cannot log in to datahub.io (server error: 524)

[sglavoie]

When I try to log in to datahub.io, I want to be able to access the website quickly and perform actions in my account so that I can work with datasets from the browser and the command line.

Acceptance

• [x] The user can log in successfully to datahub.io with both authentication options without any server error (e.g., 524): GitHub and Google.

Tasks

• To be updated with more details once the tasks to perform are properly understood.
• [x] Confirm that logging in is working through Google.
• [x] Confirm that logging in is working through GitHub.
• [x] Confirm that the user can perform actions with the server while logged in.
  • [x] The user must be able to load the dashboard.
  • [x] The user must be able to perform other actions, such as uploading a dataset.

Analysis

• Loading the page https://datahub.io/ works fine.
• Trying to log into an account doesn't work and result with a timeout with error 524 every time (the same behavior is observed from different accounts and locations).
• The user still gets logged in after refreshing the page but cannot load the dashboard: https://datahub.io/dashboard

• The same is happening with the data-cli JavaScript package from the terminal: a tab will open with the following text, however the log in is not successful:

  Thank you for logging in. You can now close this window and return to the terminal!

Error observed

User is logged in (was previously logged out)

[sglavoie]

FIXED. This is a duplicate of #259. As reported in that other issue:

• Main pages on site do not work e.g. https://datahub.io/core/
• Also organization pages e.g. https://datahub.io/world-bank

[rufuspollock]

@sglavoie how is this a duplicate of #259? they seem quite different ...

[sglavoie]

Maybe there was some confusion on my part. It looks to me like @monikappv and I are reporting the exact same issue resulting in a 524 server error. It is very likely that not being able to log in as a user is due to an error on the server (HTTP status code >= 500) that prevents access to other parts of the website, including the dashboard and the login route.

I will of course re-open this issue if you see it fit. :+1:

[rufuspollock]

@sglavoie i don't think you know these are the same source - 524 is a really generic error. I would reopen and investigate. I think you'll need to ask on Datopian devops b/c it will prob relate to internal apis in some way.

Also an aside it should not be FIXED but DUPLICATE (if indeed it were a duplicate).

[sglavoie]

Yes, you are absolutely right. I will be careful not to make such assumptions from now on and re-read the docs about closing issues as I certainly forgot about that other label. Thank you.

[sglavoie]

FIXED: All actions can be performed as normal (log in, loading pages, uploading datasets, etc.) and there is no more timeout issue when the user is logging in.

---

Solution by @zelima:

1. Go to GCP -> CPC Network -> External IP addresses
2. If the issue is the same as above you should see 4 Unused external IPs (In use by - None) and 4 used ephemeral IPs (2 for prod and 2 for testing).
3. Click change on the right of the External IP and chose appropriate service (prod for prod and test for testing, from top to bottom)
4. Save and wait for a bit

[rufuspollock]

@sglavoie can you check if this is happening again?

[sglavoie]

@rufuspollock I believe we are dealing with the same issue again. I let @zelima know about it since he was able to provide a fix last time on GCP (solution linked above).

[zelima]

@sglavoie Should be fixed.

Aside: Please ping me in the Gchat if I do not respond in a reasonable time

[sglavoie]

@zelima All working again! :tada:

Please ping me in the Gchat if I do not respond in a reasonable time

I will. Thank you. :slightly_smiling_face: