JuliaCloud / JuliaBox

Juliabox continues to run, but this codebase is no longer current.
http://www.juliabox.org/
Other
184 stars 50 forks source link

JuliaBox uptime monitoring #186

Open ViralBShah opened 9 years ago

ViralBShah commented 9 years ago

Can we setup a monitor that can auto-login to juliabox, and run a simple notebook - simulating a user in a browser. Are there tools to automate something like this? I am sure this is a pretty common request.

Every once in a while something goes wrong, since these are early days - and it would be nice to get an email/text on failure. Perhaps we can even have status.juliabox.org.

tanmaykm commented 9 years ago

One can probably use tools like selenium (http://www.seleniumhq.org/) to run an automated login and logout from JuliaBox.

We currently have our server logs getting uploaded to AWS cloudwatch. We could write some scripts to go through them and send SMS/email if a certain pattern is detected.

ViralBShah commented 9 years ago

Both sound like great options to implement.

melvin0008 commented 9 years ago

Capybara is used to test ruby applications. (Don't think its technology independent).

For Python applications there are different tools. I haven't used any of these but these seem to be good fit. Spliter lets you automate tasks and Lettuce is a BDD tool.

melvin0008 commented 9 years ago

Or like tanmay said we could write scripts to monitor each service and trigger an action when a discrepancy is found.

ViralBShah commented 9 years ago

I think the log monitoring is the easy one. We need something that simulates users using a browser.

melvin0008 commented 9 years ago

Splinter combined with lettuce will let you simulate users. Splinter allows to automate browser tasks. Wrote a small script to login to one of my in process side projects. Worked like a charm. https://github.com/melvin0008/tryingsplinter

melvin0008 commented 9 years ago

And yup for monitoring errors, monitoring logs is the optimum solution.

melvin0008 commented 9 years ago

Can I know the list of operations being tested when someone simulates a browser.
Using this script. I can login to JuliaBox using a test gmail id and then create a new notebook.
I did this using selenium.

What are the other operations needed to be performed?

ViralBShah commented 9 years ago

To start with, I would love to have a notebook that computes 1+1 and gets the correct answer.

tanmaykm commented 9 years ago

Nice, looks good! Some more basic tests I could think of:

melvin0008 commented 9 years ago

Sure . I'll get started.