Open ketansand opened 1 month ago
The files have been generated and are at their respective location in /data/user-data/ksand/exposure_files/
This is the initialization of the stack
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | Reading /usr/local/lib/python3.9/site-packages/workflow/workspaces/chimefrb.yml
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | Workspace chimefrb set to active.
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | Currently using chimefrb workspace.
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Workspace:
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | /root/.config/workflow/workspace.yml
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Log Level: INFO
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.lifecycle.process Running
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | with active workspace.
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Workflow Run CLI
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Buckets :
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | ['exposure-test']
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Function : None
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Command : None
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Mode : Dynamic
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Lives : infinite
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Sleep : 30s
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Log Level: INFO
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Work Filters
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Site : chime
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Workspace Config
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Baseurls: {'buckets':
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 'https://frb.chimenet.ca/buckets', 'loki':
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 'https://frb.chimenet.ca/loki/loki/api/v1/push
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | ', 'pipelines':
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 'https://frb.chimenet.ca/pipelines',
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 'products':
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 'https://frb.chimenet.ca/frb-master/v1/events/
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | query-file?filename=', 'results':
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 'https://frb.chimenet.ca/results'}
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Execution Environment
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Operating System: Linux
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Python Version :
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 3.9.19
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Python Compiler : GCC
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 12.2.0
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli TTY Detected : False
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Backend Checks
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Loki Logs: ✅
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | /usr/local/lib/python3.9/site-packages/pydantic/main.py:192: FutureWarning: WORKFLOW_TOKEN missing. Token auth will be required in the future.
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | self.__pydantic_validator__.validate_python(data, self_instance=self)
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Buckets : ✅
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli System Checks Complete
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:02 UTC INFO chimefrb.workflow.cli Starting Workflow
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | Lifecycle
⠸04 Jul 2024 17:06:33 UTC INFO 6686d695db4d94dbc60a0bed
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | chimefrb.workflow.lifecycle.attempt got work:
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | ✅
⠴04 Jul 2024 17:06:34 UTC INFO 6686d695db4d94dbc60a0bed
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | matplotlib.font_manager generated new
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | fontManager
Using hard-coded default config. Run update_from_site_config() toget config from
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | kotekan
⠋04 Jul 2024 17:06:35 UTC INFO 6686d695db4d94dbc60a0bed
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | chimefrb.workflow.lifecycle.execute executing
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | as python function: get_uptime(**{'startdate':
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | '20240601', 'enddate': '20240615',
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 'outputdir':
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | '/data/user-data/ksand/exposure_files'})
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:36 UTC INFO 6686d695db4d94dbc60a0bed
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | exposure.exposure_beam_days_workflow The
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | startdate is 20240601 and the enddate is
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 20240615, getting the datelist
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | 04 Jul 2024 17:06:36 UTC INFO 6686d695db4d94dbc60a0bed
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | exposure.exposure_beam_days_workflow Getting
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | daily exposure for 2024-06-01 00:00:00+00:00
exposure-test_exposure.1.yrrptkvog9wt@cfen4 | to 2024-06-02 00:00:00+00:00
/usr/local/lib/python3.9/site-packages/exposure/exposure_beam_days_workflow.py:1
I am using this docker compose file, which can be found on frb-vsop in
/home/frbadmin/docker_compose_exposure.yaml
I am seeing logs when I do
docker service logs -f exposure-test
But not seeing anything on the workflow-web page - https://frb.chimenet.ca/workflow/results/exposure-test/6686d695db4d94dbc60a0bed![Screenshot 2024-07-04 at 1 49 48 PM](https://github.com/CHIMEFRB/workflow/assets/55292615/c55b8fa7-87ec-44d1-8a1d-5ab508397593)
There is no new path created in
/data/chime/baseband/processed/workflow/20240704