Inconsistent lab analytics data in stats analytics service

[ksripathi]

Currently usage, hits and visits of Labs running on nonopendx platform are processed by erlang program and output statistics results were stored into output.txt file on stats.vlabs.ac.in server for every 2 hrs regular interval of time

Every record in =output.txt= file has the following format

lab_id, lab_name, hits, visits, usages

Some of the entries in output.txt files has no lab_id or no lab_name,..but with visits, hits and usage values... etc with no proper information. This issue captures cleaning up such data and store the lab details data into LDS if not present

[ksripathi]

Total records in =output.txt= = 182 Labs data found on LDS out of 182 = 90

I have cleaned up 66 records of out 183 which are dummy (like, test1, test2, lab000, abcd.eetc)

Following are the list of remaining labs (26) for which LDS doesn't have information [ { "lab_id": "mech01", "hits": 188, "institute_name": "IIT-Guwahati", "visits": 65, "lab_name": "Virtual Laboratory Experience in Fluid and Thermal Sciences", "usage": 0 }, { "lab_id": "sc01", "hits": 64, "institute_name": "None", "visits": 20, "lab_name": "None", "usage": 0 }, { "lab_id": "hss01", "hits": 1534, "institute_name": "Prototyping and Experiential Simulation Lab\"", "visits": 300, "lab_name": "\"Creative Design", "usage": 0 }, { "lab_id": "engg01", "hits": 181, "institute_name": "None", "visits": 52, "lab_name": "None", "usage": 0 }, { "lab_id": "ece23", "hits": 0, "institute_name": "IIT-Roorkee", "visits": 0, "lab_name": "Digital Electronics", "usage": 0 }, { "lab_id": "ece09", "hits": 171, "institute_name": "IIT-Delhi", "visits": 39, "lab_name": "Wireless Lab", "usage": 0 }, { "lab_id": "ece06", "hits": 163, "institute_name": "IIT-Kharagpur", "visits": 36, "lab_name": "Digital Signal Processing Lab", "usage": 0 }, { "lab_id": "ece05", "hits": 22474, "institute_name": "IIT-Guwahati", "visits": 4079, "lab_name": "Digital VLSI Design Virtual Lab", "usage": 0 }, { "lab_id": "ece02", "hits": 0, "institute_name": "IIT-Delhi", "visits": 0, "lab_name": "Electro Magnetic Transmission (Virtual MEMS Lab)", "usage": 0 }, { "lab_id": "ece01", "hits": 26447, "institute_name": "IIT-Guwahati", "visits": 2755, "lab_name": "Speech Signal Processing (IIT-G)", "usage": 0 }, { "lab_id": "cse28", "hits": 0, "institute_name": "IIT-Kharagpur", "visits": 0, "lab_name": "Advanced Network Technologies", "usage": 0 }, { "lab_id": "cse27", "hits": 0, "institute_name": "None", "visits": 0, "lab_name": "None", "usage": 0 }, { "lab_id": "cse26", "hits": 0, "institute_name": "IIIT-H", "visits": 0, "lab_name": "Network Security", "usage": 0 }, { "lab_id": "cse25", "hits": 0, "institute_name": "IIIT-H", "visits": 0, "lab_name": "Wireless Sensor Networks", "usage": 0 }, { "lab_id": "cse232", "hits": 0, "institute_name": "None", "visits": 0, "lab_name": "None", "usage": 0 }, { "lab_id": "cse08", "hits": 1777, "institute_name": "IIT-Kharagpur", "visits": 389, "lab_name": "Software Engineering", "usage": 0 }, { "lab_id": "civil09", "hits": 425, "institute_name": "IIT-Bombay", "visits": 108, "lab_name": "Traffic Engineering", "usage": 0 }, { "lab_id": "che02", "hits": 0, "institute_name": "IIT-Guwahati", "visits": 0, "lab_name": "Virtual Lab for Mass Transfer", "usage": 0 }, { "lab_id": "ae01", "hits": 0, "institute_name": "IIT-Madras", "visits": 0, "lab_name": "Aerospace Structures Lab", "usage": 0 }, { "lab_id": "ccnsb", "hits": 0, "institute_name": "None", "visits": 0, "lab_name": "None", "usage": 0 }, { "lab_id": "ccnsb0", "hits": 0, "institute_name": "None", "visits": 0, "lab_name": "None", "usage": 0 }, { "lab_id": "ccnsb0", "hits": 0, "institute_name": "None", "visits": 0, "lab_name": "None", "usage": 0 }, { "lab_id": "che02", "hits": 0, "institute_name": "IIT-Guwahati", "visits": 0, "lab_name": "Virtual Lab for Mass Transfer", "usage": 0 }, { "lab_id": "eee24", "hits": 145093, "institute_name": "IIT-Roorkee", "visits": 54552, "lab_name": "Machine Lab", "usage": 28892 }, { "lab_id": "aerosp", "hits": 1389, "institute_name": "None", "visits": 801, "lab_name": "None", "usage": 0 }, { "lab_id": "combus", "hits": 2175, "institute_name": "None", "visits": 1699, "lab_name": "None", "usage": 0 } ]

[ksripathi]

Reference to list of lab_ids and their names : https://github.com/vlead/lab-specifications/blob/master/lab-to-id-mapping.org#association-of-an-id-to-a-virtual-lab

[travula]

@sanchita-dixit @madhavipuliraju @mrudhvika940 @BalammaBoya

Can you guys please check this. There are some labs here, that are not captured in the lds database. We should also create a new field in the database to capture this information.

So the tasks would be:

1. set up a new field - phase - in the database, phase can have multiple values 1 denotes phase 1, 2 denotes phase 2, 3 phase 3 etc.
2. Populate the db with the above labs too.

[sanchita-dixit]

@ksripathi @travula This list was showing 207 labs because it consisted of labs which were in upcoming section also, this means that either such labs are in development stage or still in proposed stage. There were no hosted URLs present for such labs. I have updated the list which could be used for analytics service

[travula]

refer issue on lds

[sanchita-dixit]

The status for this issue is captured here

[ksripathi]

All cleaned up lab's analytics data to be displayed