Weekly Goals

[cekbote]

@yongtang I think we should have this issue just to track and set some definite weekly goals. For this week , since getting the data might be an issue, I think I'll work on:

• [x] Creating a mock-up of the analysis app (a small Dash app with little to no functionality just to show how it'l work)
• [x] Incorporate some NoSQL database such as Redis into the Flask Server. (Used Elasticsearch)

If we do get the required data, then we could discuss and update this week's goals accordingly, If that's ok with you. :)

[cekbote]

Goals for 10/06/2020 to 17/06/2020:

• [x] Creating a Functional Visualization Dashboard.
  • [x] Adding a request plot that changes with respect to input time settings.
  • [x] Adding a feature to check whether a domain name is malicious or benign.
  • [x] Adding a feature to list out all the IP addresses querying that domain.
  • [x] Visualizing the top malicious domains.
  • [x] Adding a list of all the malicious domains that the database holds.
  • [x] Visualizing the top benign domains.
  • [x] Adding a list of all the benign domains that the database holds.
  • [x] Add live updates to the application.
• [x] Adding the tensorflow_model directory to this repository (Importing the code from the DNS_Alert_Model repository).
• [x] Updating the Readme file.

[cekbote]

@yongtang

Goals for 17/06/2020 to 24/06/2020 (Let me know if you'd like to add anything or make some changes)

• [x] Edit the visualization dashboard to make it include prediction percentage
  • [x] Highlight the ones with a low confidence (accuracy) percentage
• [x] Add a new visualization dashboard to handle websites where the model is not confident (Something like a ticketing application and the user can manually decide to either send back a blackhole IP or a honeypot IP)
  • [x] Make the app mockup
  • [x] Add the visualizations required
  • [x] Integrating the application with the old Dash Application
  • [x] Add minimal functionality Please take a look at https://github.com/cekbote/coredns_ml_plugin#manual-vetting
• [x] Improve the Readme
  • [x] Improve the Visualizations
  • [x] Focus more on the entire pipeline than the plugin
  • [x] Rename certain elements Please take a look at https://github.com/cekbote/coredns_ml_plugin#general-overview and https://github.com/cekbote/coredns_ml_plugin#inner-working-of-the-application
• [ ] Add documentation for the App
  • [x] Go through Sphinx Documentation
  • [x] Go through how to integrate Sphinx and Read the Docs
  • [ ] Complete docstrings for all the functions.

[cekbote]

Goals for 24/06/2020 to 8/07/2020

• [x] Creat a PPT for showcasing the project
• [x] Check whether Acumous AI would be a good fit for the project.
• [x] Split the project into difference repos under a single organisation
  • [x] Create a repo for the Golang plugin
  • [x] Create a repo for the flask server
  • [x] Create a repo for the dash application
  • [x] Create a repo for the machine learning model.
• [x] Unit testing for the different repositories
  • [x] Unit testing for the flask server
  • [x] Unit testing for the Dash application
  • [x] Create an example repository to understand how unit testing is done
  • [x] Integrate TravisCI
  • [x] Integrate Codecov Please see the repo: https://github.com/cekbote/travisci_and_codecov_example

[cekbote]

Goals for 8/07/2020 to 15/07/2020

• [x] Create a program to retrain the machine learning model locally
• [x] Create an ML Bridge logo.
• [x] Create a Training Frontend in the dash application