For the query that inserts/updates the portals table, when the portal exists all that gets updated is the updated timestamp, but some of these portals get moved, renamed, image updates, etc etc etc. The ON DUPLICATE KEY should update everything and the timestamp just to be safe. I've suggested the same for the old IITC based scraper
ClarkyKent
commented
4 years ago
For the query that inserts/updates the portals table, when the portal exists all that gets updated is the updated timestamp, but some of these portals get moved, renamed, image updates, etc etc etc. The ON DUPLICATE KEY should update everything and the timestamp just to be safe. I've suggested the same for the old IITC based scraper