Open dustinvtran opened 2 years ago
You would probably need to run a script on an external server if you wanted to do that because netlify doesn't really have good support for that. Pro plan ($19/month/member) has background functions, but even background functions may only run for up to 15 minutes. It'd be fairly simple, just clone the repo, npm install
, add the .env
file and run the script.
Due to updates, our scraped database data should be synced with the online databases every once in a while. One way this can be be achieved is with a crontab that calls the scraper script every, say, 3 months.