search

radian-software / riju

⚡ Extremely fast online playground for every programming language.
https://riju.codes
MIT License
1.63k stars 191 forks source link

Roadmap: Riju architecture improvements #151

Open raxod502 opened 2 years ago

raxod502 commented 2 years ago

Riju has some serious scalability and maintainability problems, and I've been thinking for the last few months about how to address them. For transparency, I created the following roadmap outlining my plans:

https://nextcloud.intuitiveexplanations.com/s/mHoFwFGMNCpLjim [note: moved from Google Drive to Nextcloud]

Feedback is of course welcome!

hello-smile6 commented 2 years ago

Riju has some serious scalability and maintainability problems, and I've been thinking for the last few months about how to address them. For transparency, I created the following roadmap outlining my plans:

https://docs.google.com/document/d/e/2PACX-1vRKkmilDiHXW8wpwFCplLrXRo-ANCLLTPpJ7vl4pI4diZAxr56vyuAo6NQ0ZTVYhf-X5HcQlVx3Ud9u/pub

Feedback is of course welcome!

Don't have access to the Google Doc, could you share it as a PDF?

LuckyHookin commented 2 years ago

@hello-smile6 Roadmap_ Riju architecture improvements.pdf

raxod502 commented 2 years ago

I'm curious what issue you ran into, I seem to be able to access the link in your comment using unauthenticated curl, without even any JavaScript?

hello-smile6 commented 2 years ago

I'm curious what issue you ran into, I seem to be able to access the link in your comment using unauthenticated curl, without even any JavaScript?

Permissions issues with non-gmail account.

raxod502 commented 2 years ago

You probably saw the original version of the link, which was broken. I edited the issue shortly after posting it. Try it again.

hello-smile6 commented 2 years ago

You probably saw the original version of the link, which was broken. I edited the issue shortly after posting it. Try it again.

Okay

hello-smile6 commented 2 years ago

You probably saw the original version of the link, which was broken. I edited the issue shortly after posting it. Try it again.

image Yes, I removed my email.

raxod502 commented 2 years ago

Huh, not sure what to say. When signed into another Google account that doesn't have access to that document, it works for me. Also works if I'm not signed into any Google account. It's not an IP address restriction either since I can even access it through Tor. And, as I mentioned, curl works fine with no authentication whatsoever. Perhaps it's some kind of issue that affects your account specifically. Seems like a pretty rare issue judging by the lack of discussion online about the error message.

hello-smile6 commented 2 years ago

Huh, not sure what to say. When signed into another Google account that doesn't have access to that document, it works for me. Also works if I'm not signed into any Google account. It's not an IP address restriction either since I can even access it through Tor. And, as I mentioned, curl works fine with no authentication whatsoever. Perhaps it's some kind of issue that affects your account specifically. Seems like a pretty rare issue judging by the lack of discussion online about the error message.

Okay, maybe use this link? It goes through a CORS proxy. https://cors-anywhere.9pfs.repl.co/docs.google.com/document/d/e/2PACX-1vRKkmilDiHXW8wpwFCplLrXRo-ANCLLTPpJ7vl4pI4diZAxr56vyuAo6NQ0ZTVYhf-X5HcQlVx3Ud9u/pub

hello-smile6 commented 2 years ago

@raxod502 I just used Tor as a test (for the first time) to open it, and I can confirm that it works.

plondon commented 2 years ago

Wow this is a super exciting proposal!

raxod502 commented 2 years ago

Prometheus metrics are :fire: and much better than CloudWatch.

image

hello-smile6 commented 2 years ago

Did you have an outage at 21:55 in that screenshot?

raxod502 commented 2 years ago

No, this is all on a staging instance not serving any live traffic.

hello-smile6 commented 2 years ago

No, this is all on a staging instance not serving any live traffic.

Oh.

plondon commented 2 years ago

Hi @raxod502!

Checking in on the progress and timeline (if any) of this roadmap?

raxod502 commented 2 years ago

Hey @plondon. Sorry for the delay - I've moved apartments and have been spending the last few weeks unpacking boxes and putting together furniture.

I haven't done much work on this specific roadmap, mostly because I've had other ideas about how to rebuild things from scratch using the knowledge I've gained over the last year from other infrastructure-related personal projects as well as my experience operating Kubernetes at Plaid.

I have a project in progress that is a Heroku-like platform with true user authentication and workload scheduling on Kubernetes, and a separate project that rewrites Riju to use Go microservices and a relational database. Neither of those are MVP enough that I've put them up on GitHub yet. Learning a bunch of things, but since these are all things I'm working on ad hoc in my free time, they compete with all the other stuff going on.

Let me know if I can answer any specific questions!

nyabinary commented 10 months ago

What the progress on this so far now?

raxod502 commented 10 months ago

Unfortunately, still https://github.com/radian-software/riju/issues/168. Considerable architectural work is needed to get Riju back into a state where I am able to deploy changes, and I haven't had time yet with all the other things that have taken time in my personal computing and non-computing life.