NjbSyd / CUI-ATD-Companion-Scrapper

Scraps Data from CUIATD official Site and Store in MongoDB
https://timetable-scrapper.vercel.app
0 stars 0 forks source link

Implement Real-time Timetable Change Detection Endpoint for Mobile App #10

Closed NjbSyd closed 1 year ago

NjbSyd commented 1 year ago

πŸ“ Description: Currently, the mobile app relies on daily updates, which might not be the most efficient approach. To enhance the mobile app's user experience and data synchronization, we need to implement a real-time API endpoint that informs the app whether there have been any changes in the timetable data during the scraping process. This will allow the mobile app to fetch updates only when necessary, rather than on a fixed schedule.

πŸ”§ Proposed Solution:

  1. Design and create a new real-time API endpoint dedicated to mobile app data synchronization.
  2. Integrate logic during the scraping process to detect changes in the timetable data.
  3. Create a mechanism for the mobile app to request updates from this real-time endpoint. This will be a new route added in addition to the existing routes which will respond with true if data needs to be fetched or false otherwise.

πŸ“‹ Tasks:

πŸ‘₯ Additional Information: This enhancement will improve the efficiency and responsiveness of the mobile app. By detecting changes in real-time during the scraping process, we ensure that the mobile app always has the most up-to-date information available, reducing unnecessary data transfer and enhancing the overall user experience.