Closed LKASTI closed 5 months ago
Edited to reflect changes made today
The design for the page scraper seems complete. The base code including comments for each method has been pushed to my branch 'Landin' under the directory SpringBootBackend\src\main\java\com\services\scraper
. The design should be discussed amongst the back-end team at some point. Then issues can be created and posted on the project board for methods.
PageItem:
PageScraperService: (this could be more efficient if we knew which page items were newly added or just updated)
must be have access to location, appointment, club, and event entities
FIELDS: HashSet pageItems;
METHODS: Helper scrapePageItems() iterate over page items gets title checks if event title already in database and skips if yes get url add object to pageItems
PageScraperController: