3. Working Group Meeting

[ghost]

Date: 2th December, 2018

@doktorgibson

• [x] crawl all URLs for given website (URLCrawler-DataModule) (postponed)
• [x] determine when a website is finished loading to take a screenshot #13
• [x] take screenshot of given website (Screenshot-DataModule)
• [x] create dataset version 1 #6
• [x] start writing about CEF, #13, #12 and overall scaling and architecture

@Simsso

• [ ] write a toy example with the graph nets library #3
• [x] assess usability of the graph nets library based on the experiments and close #3 thereafter
• [x] do research on best practices for screenshot processing #4
• [x] draft a list of possible outputs and solutions to the set to scalar problem in #5 (cannot be closed before data is available)

[ghost]

@Simsso I set the time for the next working group meeting. Since URL crawling is currently not relevant, I postponed it.

Furthermore I added the task to write the very early things about CEF, our When-to-take-a-Screenshot-Problem and our overall design (module system). Until then I also had to solve the problem of the analysis time for 100k, so there will also plenty to write about.

[Simsso]

Minutes

• Decision to implement the required features of the graph nets library in PyTorch because of the ongoing changes in the TF ecosystem (v2).
• Possible loss functions listed
• First network architecture found (to get started with)
• Dataset v1 is almost complete, one GCP problem is to be fixed