PNNL-CompBio / srpAnalytics

This repository contains the code necessary to process any new data for the Superfund Research Program Analytics Portal.
MIT License
5 stars 0 forks source link

automate database build trigged by edit of file list. #73

Closed sgosline closed 4 days ago

sgosline commented 7 months ago
  1. Move build script files to csv stored on github
  2. Build script to read file and download files as step 0 of build
  3. Update build scripts to be triggered by csv update and call step number 2.
sgosline commented 3 months ago

More details: Any edit to this file should trigger a github action that reads in files, processes them using bmdrc docker (#78), harmonizes them using the bmd2Samps docker, adds in zfExp files, exposome files, then runs through validation script (#40)

sgosline commented 3 months ago

Adding overall automation pipeline

Screenshot 2024-04-10 at 8 58 49 AM
sgosline commented 2 months ago

The script now works thanks to #85 but needs to be encoded into github actions

sgosline commented 2 months ago

ACtions will be encoded as such: https://docs.github.com/en/actions/creating-actions/creating-a-docker-container-action

sgosline commented 4 days ago

figshare push is now working, ish.