openedx-vlead / college-cloud

1 stars 2 forks source link

How to get data from College Cloud version of Virtual labs ? #7

Open ashay-maheshwari opened 7 years ago

ashay-maheshwari commented 7 years ago

Meeting minutes for January 16, 2017

  1. Why do we need to fetch data from College Cloud ?
  2. How are we going to get data from College Cloud ??
  3. Are we interested in Workshop data only ? What about the data for normal and daily usage of college cloud ?
  4. Post processing of data - Not discussed.

Multiple things came into discussion and they are the following -

  1. Give a simple shell script which will fetch the data we are interested in and sys admin will take it in pendrive and send it to engg@vlabs.ac.in -- implemented as of now

  2. Give a Web based portal to upload data ( suggestions - owncloud, outreach, google drive, Dropbox ) -- Challenges browser based uploads can fail because of internet connections

  3. Human behaviour and ignorance to send data can make it tough for us to get data at VLEAD end . This includes ( careless to upload data, need permissions because of process etc)

  4. Data can be uploaded to outreach portal with specific tag of workshop

  5. Session management can resolve the of failed uploads. Thirumal can explain more.

  6. Give internet connection to College cloud once in a week and let an API get all data to a service running in VLEAD.

ashay-maheshwari commented 7 years ago

Focused on Pre and Post processing of College Cloud logs (feedback, analytics and user database). A Shell script is given as utility which can get -

  1. Full logs for feedback, analytics and user data
  2. Date wise logs for feedback and analytics and partial user data (default)

Full logs will only be taken if requested. By default, date wise logs will be uploaded by user. Steps for sys admin to perform those is - https://github.com/openedx-vlead/college-cloud/blob/master/src/post-processing/index.org.