Open RyanSimas opened 3 years ago
Date: September 20th, 2021
1 - Yesterday there was nothing done as I have already competed the majority of my section for the sprint. 2 - Today I will likely create keys for the team to have access to the database server 3 - Depending on how it goes, AWS could make it more complicated to add additional keys to the project.
Date: September 20th, 2021
Date: September 20th, 2021
Date: September 20th, 2021
Date: September 21st, 2021
Date: September 21st, 2021
Date: September 21st, 2021
Date: September 22th, 2021
Date: September 22nd, 2021
Date: September 22nd, 2021
Date: September 23rd, 2021
Date: September 23rd, 2021
Date: September 23rd, 2021:
Date: September 23rd, 2021
Date: September 24th, 2021
Date: September 24th, 2021
Date: September 25th, 2021
Date: September 25th, 2021
Date: September 26th, 2021
Sprint ends tomorrow, no news to report for today
Date: September 27, 2021
Date: September 27th, 2021
Date: September 27th, 2021
Date: September 28th, 2021
Date: September 28th, 2021
Date: September 28th, 2021
Date: September 28th, 2021
Date: September 29th, 2021
Date: September 29th, 2021
Did yesterday: Continue working on backend for signup and login page. Did today: Completed signup and login page. Blockers: n/a
Date: September 29th, 2021
Date: October 4, 2021
Jesse Thomas Date: Oct 15th, 2021 Yesterday: sprint 2 planning Today: Started research on elastic search Blockers: mid terms and other classes
Noah McKearney Date: October 15th, 2021 Did yesterday: Sprint 2 planning. Did today: Continue to learn how to input data into ElasticSearch. Blockers: N/A
Ryan Simas October 15, 2021
Aaliyah Ortiz October 15, 2021
Date: October sqrt(324), Name: Jesse Thomas Q. What did I do yesterday? A. I suffered through the great 7 seas of trying to complete the monstrosity of my mid-terms, of which the great white shark 'Machine Learning' and the Gate-Keeping Dolphin 'Junior Software Engineering' were attacking me unrelenting. The battle was ferocious but I came out alive and on top.
Q. What am I doing today? A. Today I will likely read more into Elastic search and help re-organize our sprint plan and probably eat baked beans later
Q. What are my blockers? A. The next battle of Helgen, dubbed 'Operating Systems Midterm'
Ryan Simas Date: October 18,2021
Noah McKearney Date: October 18th, 2021 Did yesterday: Figured out how to get websites so the user can search for keywords. Came up with a configure page where the user can type in websites, these websites are scraped and text is placed into ElasticSearch to be search. Did today: Reorganize sprint. Blockers: N/A
Aaliyah Ortiz Date: October 18th, 2021
Ryan Simas October 19, 2021 Yesterday: Reorganized sprint and work on login page Today: Continue working on login page Blockers: Midterm assignments
Noah McKearney Date: October 19th, 2021 Did yesterday: Reorganized sprint. Did today: Create a server on AWS for ElasticSearch and connect to project. Blockers: N/A
Jess Thomas Date: October 19th, 2021 1 - I spent a decent portion of yesterday studying elastic search and how we can apply it 2 - Today I've done some similar stuff 3 - Mid terms keep me from being able to put in any serious work until later this week so it's primarily research until later
Aaliyah Ortiz Date: October 19th, 2021
Noah McKearney Date: October 20th, 2021 Did yesterday: Tried to create a server for ElasticSearch on AWS and connect to the project. Did today: Still working on trying to connect ElasticSearch to the project and creating a server. Blockers: N/A
Jesse Thomas Oct 20 1 - Blocked by mid term 2 - Started to attempt to learn how to scrape web data 3 - operating systems
Ryan Simas October 20, 2021 Yesterday: Worked on login frontend Today: Continue styling login frontend Blockers: Midterms
Aaliyah Ortiz Date: October 20, 2021
Jesse Thomas Date: Oct 21st, 2021 Yesterday: started to learn the web scrape Today: a little more research into web scraping and APIs Blockers: finalizing mid terms and diff eq stuff
Noah McKearney Date: October 21st, 2021 Did yesterday: Tried to create a server for ElasticSearch on AWS and connect to the project (didn't work). Did today: Looking at websites to figure out how to connect ElasticSearch to project. Blockers: Midterms
Ryan Simas October 21, 2021 Yesterday: Worked on login screen front end Today: Continue styling login frontend Blockers: Midterms and Labs
Aaliyah Ortiz October 21, 2021
Jesse Thomas October 22 2021 Yesterday : Research into web scrape Today: N/A Blockers: No more!
Noah McKearney Date: October 22nd, 2021 Did yesterday: Looked at websites to see how to setup the project to support ElasticSearch. Did today: Continue to look at websites to figure out how to connect ElasticSearch to project. Will try to connect ElasticSearch to the project this weekend and create a server if needed. Blockers: N/A
Ryan Simas October 22,2021 Yesterday: Worked on login screen front end Today: Continue styling login frontend Blockers: N/A
Aaliyah Ortiz October 22, 2021
Jesse Thomas Date: October 25th, 2021 Did yesterday: Research on web scrape Did today: Started playing around with web scraping in Python Blockers: A marginal blocker on the database portion is no elasticsearch yet though I intend on implementing the structural code in general this week
Noah McKearney Date: October 25th, 2021 Did yesterday: Created a AWS server and added ElasticSearch to it. Did today: Create a configuration page to add websites to be scraped and searched. Blockers: N/A
Ryan Simas October 25, 2021 Yesterday: N/A Today: Finish styling both login and signup GUI Blockers: N/A
Aaliyah Ortiz October 25, 2021
Jesse Thomas Date: October 26th, 2021 Did yesterday: Started playing around with web scraping Did today: Did more web scraping stuff but ran into a lot of issues with python Blockers: Python / Inexperience
Noah McKearney Date: October 26th, 2021 Did yesterday: Worked on creating a configuration page to add websites, which will be webscraped and searched. Did today: Finished configuration page. Blockers: N/A
Ryan Simas October 26, 2021 Yesterday: Worked on Login page Today: Finished styling login GUI and working on the signup GUI Blockers: History paper
Aaliyah Ortiz October 26, 2021
Ryan Simas October 27, 2021 Yesterday: Finished styling the login and signup GUI Today: Helping backend if they need me. Otherwise, I will be working on design Blockers: N/A
Noah McKearney Date: October 27th, 2021 Did yesterday: Finished configuration page. Did today: Worked on connecting ElasticSearch to project by looking at code examples and learned more about ElasticSearch commands. Blockers: N/A
Jesse Thomas Date: October 27th Yesterday: web scraping Today: Working on making the web scraping more relevant for our project and how to store data for database Blockers: n/a
Aaliyah Ortiz Date: October 27th, 2021
Ryan Simas October 28, 2021 Yesterday: Worked on styling for main paige and nav bar Today: Continuing styling the main page and nav bar Blockers: Search functionality is not implemented yet so I cannot fully style the main page
Noah McKearney Date: October 28th, 2021 Did yesterday: Worked on connecting ElasticSearch to project by looking at code examples and learned more about ElasticSearch commands. Did today: Tried to create a EC2 instance with Elasticsearch on it to add to the project, so everyone can add data and search for keywords without using a localhost. Blockers: N/A
Jesse Thomas Date: October 28th, 2021 Did yesterday: Did some web scraping Did today: Switched gears to database for saving websites to complete before end of sprint Blockers: N/A
Aaliyah Ortiz Date: October 28th, 2021 Did yesterday: Fixed an error with nest and researched in how certain functions work Did today: Use nest and connect ElasticSearch properly to get the search functionality on the main page working Blockers: Papers/Presentations in other classes
Noah McKearney Date: November 9th, 2021 Did yesterday: Planned for sprint. Did today: Figure out what fields are needed to save a website to ElasticSearch. Blockers: Backend for saved websites blocking me from adding websites to ElasticSearch.
Ryan Simas Date: 11/9/2021 Did yesterday: Sprint 3 planning Did today: Reformatting GUIs to fit on every size screen Blockers: N/A
Jesse Thomas Date: November 9th, 2021 Did yesterday: Sprint planning Did today: Worked on finishing the retrieving function for pulling users saved websites Blockers: n/a
Aaliyah Ortiz Date: November 9th, 2021 Did yesterday: Sprint planning Did today: Downloaded MetricBeat and started configuring it to connect it with ElasticSearch to allow for it to be updated with the data from the MySQL data. Blocker: Other assignments in other classes
Jesse Thomas Date: November 10th, 2021 Did yesterday: Worked on finishing retrieval function for pulling users saved websites Did today: Fixing an issue with the save function and finalising the retrieve function for websites Blockers: A little bit of MySQL issues here and there but working them out as I go
Noah McKearney Date: November 10th, 2021 Did yesterday: Figure out what fields are needed to save a website to ElasticSearch. Did today: Continue to figure out what fields are needed to save a website to ElasticSearch, while waiting for backend for a saved page. Blockers: Backend for saved websites blocking me from adding websites to ElasticSearch.
Ryan Simas Date: 11/10/2021 Did yesterday: Reformatted all finished screens so that they look the same throughout every machine Did today: Designing the Configure websites page Blockers: Waiting on backend to finish display functionality so I can style the website data being displayed from the database
Aaliyah Ortiz Date: November 10th, 2021 Did yesterday: Downloaded MetricBeat and started configuring it so that it can update ElasticSearch with data from MySQL database. Did today: Continuing with configuring MetricBeat. Blockers: One part of the steps in the configuration is giving me issue so I need to do some additional research to fix it so that I can finish the configuration then add the module for sql onto MetricBeat
Jesse Thomas November 11th, 2021 Yesterday: fixing save and retrieve Today: cleaned up code for save and retrieve function and actually got them both to work as intended while looking decent in some regard Blockers: n/a
Noah McKearney Date: November 11th, 2021 Did yesterday: Continue to figure out what fields are needed to save a website to ElasticSearch, while waiting for backend for a saved page. Did today: Worked on displaying user's websites on config page and figured out how to save a user's username that is logged in to use across the application. Blockers: N/A
Ryan Simas Date: 11/11/2021 Did yesterday: Finished designing the configure websites page Did today: Begin styling search results Blockers: N/A
Aaliyah Ortiz Date: November 11th, 2021 Did yesterday: Configuring MetricBeat Did today: Fixing an issue that came up when I was configuring MetricBeat Blockers: N/A
Noah McKearney Date: November 12th, 2021 Did yesterday: Worked on displaying user's websites on config page and figured out how to save a user's username that is logged in to use across the application. Did today: Worked on modifying rest command to add websites to username's index in Elasticsearch. Blockers: N/A
Ryan Simas Date: 11/12/2021 Did yesterday: Fixed formatting Did today: Worked on main page Blockers: N/A
Jesse Thomas Nov 12 2021 Yesterday: fixed retrieve and save buttons and cleaned up code Today: N/A Blockers: n/a
Aaliyah Ortiz Date: November 12th, 2021 Did yesterday: Fixing an issue that came up when I was configuring MetricBeat Did today: Adding the sql module onto MetricBeat then test if it’ll update ElasticSearch Blockers: N/A
Ryan Simas Date: 11/15/2021 Did yesterday: N/A Did today: Fixed formatting issues with main page and webConfig page. Added a logout button in the nav bar and formatted the nav bar. Blockers: N/A
Jesse Thomas Date: November 15th, 2021 Did yesterday: Partied like it was 1969 Did today: Fixed an issue with one of the tables being in read-only mode on MySQL Workbench which wouldn't allow easy deletion of rows in it Blockers: N/A
Aaliyah Ortiz Date: November 15th, 2021 Did yesterday: N/A Did today: Redownloaded Kibana to then configure that and ElasticSearch to continue with the configuring process for Metricbeat because I had missed a step so I needed to backtrack to fix it. Blockers; N/A
Noah McKearney Date: November 15th, 2021 Did yesterday: N/A Did today: Worked on connecting logout button with backend to sign-out user and updated search function in ElasticManager.cs to search for keywords in username's index on ElasticSearch. Blockers: N/A
Jesse Thomas Date: November 16th 2021 Yesterday: fixed a table issue in mysql Today: n/a Blockers: classes
Noah McKearney Date: November 16th, 2021 Did yesterday: Worked on connecting logout button with backend to sign-out user and updated search function in ElasticManager.cs to search for keywords in username's index on ElasticSearch. Did today: Updated fields for ElastiSearch and made sure that delete button on config page deletes website from mysql and ElasticSearch. Blockers: N/A
Ryan Simas Date: 11/16/2021 Did yesterday: Fixed formatting issues with main page and webConfig page. Added a logout button in the nav bar and formatted nav bar Did today: Started formatting the saved websites on the webconfig page Blockers: N/A
Aaliyah Ortiz Date: November 16th, 2021 Did yesterday: Redownloaded Kibana to then configure that and ElasticSearch to continue with the configuring process Did today: Configuration w/Kibana and ElasticSearch Blockers: Other classes
Jesse Thomas Date: Nov 17th 2021 Yesterday: n/a Today: Started to look more at the web scraping stuff to get a better idea where to start Blockers: n/a
Noah McKearney Date: November 17th, 2021 Did yesterday: Updated fields for ElastiSearch and made sure that delete button on config page deletes website from mysql and ElasticSearch. Did today: Refactored code in DBManager.cs. Blockers: N/A
Ryan Simas Date: 11/17/2021 Did yesterday: Started formatting the saved websites on the webconfig page Did today: Continue formatting the saved websites on the webconfig page Blockers: N/A
Aaliyah Ortiz Date: November 17th, 2021 Did yesterday: Configuration w/Kibana and ElasticSearch Did today: Adding MySQL module onto MetricBeat Blockers: Homework in other courses
Jesse Thomas Date: November 18th, 2021 Did yesterday: started to look at web scraping stuff Did today: n/a Blockers: homework
Noah McKearney Date: November 18th, 2021 Did yesterday: Refactored code in DBManager.cs. Did today: Researched how to clear cache to fix an issue when a user logs out, logout button is still displayed. Blockers: N/A
Ryan Simas Date: 11/18/2021 Did yesterday: Continued formatting the saved websites on the webconfig page Did today: Finishing up formatting the saved websites on the webconfig page Blockers: N/A
Aaliyah Ortiz Date: November 18th, 2021 Did yesterday: Adding MySQL module onto MetricBeat Did today: Continuing to add the MySQL module onto MetricBeat and starting to work on the IP presentation slides Blockers: Homework
Jesse Thomas Date: November 19th, 2021 Did yesterday: n/a Did today: started looking at python libraries to help for web scraping Blockers: n/a
Noah McKearney Date: November 19th, 2021 Did yesterday: Researched how to clear cache to fix an issue when a user logs out, logout button is still displayed. Did today: Couldn't get anything done for the project due to a family emergency. Blockers: N/A
Ryan Simas Date: 11/19/2021 Did yesterday: Continued formatting the saved websites on the webconfig page Did today: Setting up trash can as delete button on web config page Blockers: N/A
Aaliyah Ortiz Date: November 19th, 2021 Did yesterday: Continuing to add the MySQL module onto MetricBeat and starting to work on the IP presentation slides Did today: Was working on other homework in other classes so I couldn’t continue to make sure the configuration on MetricBeat, Elasticsearch, and Kibaba is working Blockers: Homework
Noah McKearney Date: November 22th, 2021 Did yesterday: N/A Did today: Fixed issue with logout button not changing to login button when logout button is pressed from config page. Blockers: Webscraped text from webpage.
Ryan Simas Date: 11/22/2021 Did yesterday: N/A Did today: N/A due to blocker Blockers: Waiting for web scraped text to complete last task
Jesse Thomas Date: November 22nd, 2021 Did yesterday: Started to look at python libraries for web scraping Did today: Implemented web scraping with python and selenium library Blockers: N/A
Aaliyah Ortiz Date: November 22nd 2021 Did yesterday: Started using a different method to update elasticsearch with data from MySQL Did today: Continuing implementation that I started yesterday Blockers: Other homework