Open mike-gangl opened 1 month ago
We'll need to work with the various teams to do the monitoring, viewing search results and downloading the data. If any issues come up, we'll need to make sure we're working them in the unity-all channel so that we get insights and fixes made.
I have concerns over the right cwl_dag (generic) being deployed to the airflow environment. I have concerns over the ability for SPS to write to venue bucket (permissions) I have concerns over the ability of Jupyter to read from the venue bucket (permissions)
I have had issues testing this for a week and a half. Will try testing again this week
This workflow will follow the "happy path" listed on https://lucid.app/lucidchart/42e6a4fa-a0b6-48ae-99db-784eed519b4c/edit?page=gtwMI5NZgBEf&invitationId=inv_083b1130-a8dd-4926-abab-8d0f377b4b07#
Execute an SBG application package on the untiy-venue-test airflow system