search

Empirical-org-Archive / Empirical-Core-Ideas

Post ideas here for Empirical Core. This repo is being for its issue tracker.
0 stars 0 forks source link

Set up Runscope to monitor for malformed data. #38

Open petergault opened 9 years ago

petergault commented 9 years ago

From @petergault on February 27, 2015 16:45

What: When teachers are assigning activities, the site is creating multiple activity sessions. This bug has cropped up multiple times, and it is a serious bug. The question is whether we can somehow either: (1) monitor the app to see when multiple instances of the same activity session are being created at the same moment or (2) preventing the system from creating more than one activity session at a time (i.e. if a teacher is batch assigning 5 activities to 10 students, it should only create 50 activity sessions. If it creates 100 sessions or 250 sessions or any number that is not 50, the site should prevent this from happening).

How: Here are some potential options for how we can perhaps monitor this behavior. These might not be the right tools, and perhaps the solution is to limit the behavior rather than monitor the errors:

https://www.runscope.com Runscope verifies that your APIs are returning the right data, even for complicated multi-step workflows and chained requests.

http://apimetrics.io/ Set customizable failure alerts for badly formed JSON or other unexpected results. Configure sequences of tests from our online tool for the key scenarios you depend on, then run them from anywhere in the world.

Copied from original issue: empirical-org/Empirical-Core#579

petergault commented 9 years ago

Response from Runscope

Thanks for reaching out and explaining the issue you're trying to solve. Can you tell us a little more about the overall LMS assignment creation process? We're mostly interested in finding out which of the interactions in this process are triggered by API calls.

For example, when teachers are assigning the activities, are API calls made to the LMS and then the LMS creates the assignment? Also, how does the LMS create the assignment (is it a database insert or are there an additional series of API calls)?

Our tools can log/record the API calls if you convert the endpoints to Runscope URLs (https://www.runscope.com/docs/debugging). This allows the request to pass through a Runscope gateway before reaching the endpoint. Therefore, if the problem is with one or more of your API calls, you may be able to track down this bug using Runscope.

Also, just to check, are you able to replicate this bug with some consistency?

We look forward to hearing more about the LMS assignment creation process so that we can determine whether our tools will help you to track down this bug. Thanks in advance.

petergault commented 9 years ago

e.g. Sarah Angel

petergault commented 9 years ago

@marcellosachs update - this actually might be happening for a different reason, and this might not be an actual bug. For now I am going to strip the priority from this.