Automatically update database data periodically

[dustinvtran]

Due to updates, our scraped database data should be synced with the online databases every once in a while. One way this can be be achieved is with a crontab that calls the scraper script every, say, 3 months.

[ghost]

You would probably need to run a script on an external server if you wanted to do that because netlify doesn't really have good support for that. Pro plan ($19/month/member) has background functions, but even background functions may only run for up to 15 minutes. It'd be fairly simple, just clone the repo, npm install, add the .env file and run the script.

[ghost]

Subtasks

• [ ] Write script that updates database entries
• [ ] Have that script run every 3 months on a server