hapi-server / servers

Catalogs of known HAPI servers
0 stars 4 forks source link

retrieve data from about responses and merge into new all.json #20

Open jbfaden opened 6 months ago

jbfaden commented 6 months ago

For each server in all.json, we need to periodically check to see if its about response has changed at all and merge in that content.

jbfaden commented 6 months ago

See https://github.com/hapi-server/servers/blob/20240208-all-json/src/from_servers_json_to_txt.py

rweigel commented 6 months ago

For "periodically" I would like to use

https://medium.com/nerd-for-tech/lets-run-cron-jobs-using-github-actions-df64496ffc4a

instead of running it on one of our machines.

I suggest configuring so that a push (a hand change to all.json) will trigger a re-build of all.json (replacing existing any existing field with corresponding field returned by a server /about) and then re-builds via cron every one or or so.

Will need to use https://docs.github.com/en/actions/managing-workflow-runs/skipping-workflow-runs to prevent infinite recursion because push of all.json will trigger run of python script and then push of modified, which will trigger another run.