search

ActoKids / AD440_W19_CloudPracticum

3 stars 1 forks source link

Save data and events resolution #21

Open mrvirus9898 opened 5 years ago

mrvirus9898 commented 5 years ago

Our crawlers will need to save data as part of their normal and intended operation. However this data will not be ideal. It will be messy, and will require some interpretation. Please model some higher level logic (via list, if-statements, flowchart, ranking, or whatever) for messy or incomplete data. Consider what information is required, and what information we can assign to a default value if need be.

You do not need to define these defaults at this point, simply what we could get away with defaulting.

Please indicate the time spent on this, any issues that you are having, any good references you found for this subject, and credit anyone helped you out.

mrvirus9898 commented 5 years ago

Will assign to Kyrrah when he joins this github

kyrrahnork commented 5 years ago

I have joined and have done some basic overview research. A lot of the data, as nick said, will be messy. I will work on some logic for saving and formatting data this week to ensure proper passing to being mapped and saved. This will also allow for standardized exporting of JSON to the app from the database. I estimate another 5 hours of research to complete this task. I have spent 4 already. Max overall, approx 10hrs.