version: 2024.04.2
This repository contains the code behind the UK Meteors data archive and data processing pipeline.
The code for archive.ukmeteors.co.uk, including the data processing pipeline.
The software is a mix of Python and Bash shell scripts. All software deployment uses Ansible.
The shell scripts and python code are deployed with deploy-analysis.yml. Use the "prod" tag to push to production, and the "dev" tag to push to a development environment. Deployments target the batch server in the MM account.
ansible-playbook deploy-analysis.yml -t prodParameters are created with Terraform and stored in the AWS Systems Manager Parameter Store.
The configuration is then deployed with deploy-config.yml which runs a script to create the config.ini file.
Much of the website is dynamically created by the Python and Bash scripts or by AWS Lambda functions.
There is some static content (mostly css and js files) that is pushed to the batch server along with the python
and shell scripts, and then deployed to the webserver by running website/pushStatic.sh env where as before, "env" is either "prod" or "dev".
Done with Terraform - see the Terraform folder readme for details.
This folder contains tests for the APIs and some of the Python code. Further tests are being developed and will be added to this folder. See the README in the folder for more details.
A python app that is used to add/modify contributors' camera details and grant them permission to upload. Not intended for general use, this tool can only be used if you have SSH and AWS keys for the admin role.