Ameobea / network_research

Misc. files and scripts used for network research
2 stars 3 forks source link

Document Daily Progress & New Tasks -- Casey #18

Closed Ameobea closed 8 years ago

Ameobea commented 8 years ago

This is set as a daily task for each student Team Member. Update the Asana project tasks, and research record.

┆Issue is synchronized with this Asana task

Ameobea commented 8 years ago

Today was focused around the HTML report generator. Taking the results from the processor and analyser scripts, I compiled a HTML document that contains the the results formatted in a table by network.

The HTML file includes functionality to hide long data points and view them in another area by clicking them in order to prevent the extremely long node lists from spamming up the page.

I debugged some issues with the updated processor script on Samm and AnnaLees' computers that were due to Windows taking longer to close processes than Linux and the differences between file system architecture on the different systems. However, at the end of the day, the script with all its functionality including full multi-process calculation runs on all machines tested.

The next steps going forward will be to start to utilize this processing pipeline to gather large amounts of raw data from as many networks as possible with the goal of gathering a large set of data to use for coming up with classification algorithms.