Status emitter tool to work with new ades-pbs getStatus schema.

[jjacob7734]

The ades-pbs getStatus JSON response has been updated to support our new schema at https://docs.google.com/presentation/d/1bTMKPRAeioxsKv7okcvWYjIbXoynmB8T8H2bL3vzYLU/edit#slide=id.g14215199578_0_2205. This ticket is to adapt the status emitter tool and ensure it works with the new schema.

Definition of Done:

• [x] Demonstrate the status emitter acquiring job status information from ades-pbs and loading it into Elasticsearch.

[jjacob7734]

Example getJobStatus response from the updated ades-pbs: > curl http://127.0.0.1:5000/processes/downsample-dem-workflow-0.0.1/jobs/downsample-dem-workflow-0.0.1-1006555aa1bdb93853678b1f5c05c0b6a92bcb0d { "ades_id": "ades-pbs-dev-jjacob-01", "api_version": "1.0", "statusInfo": { "jobID": "downsample-dem-workflow-0.0.1-1006555aa1bdb93853678b1f5c05c0b6a92bcb0d", "job_type": "downsample-dem-workflow-0.0.1", "metrics": { "downsample_dem": { "exit_code": 0, "memory_max_gb": -999.0, "node": { "cores": 1, "disk_space_free_gb": 2381834.4552001953, "hostname": "r623i0n0.p4.nas.nasa.gov", "ip_address": "10.150.37.118", "memory_gb": 125.30337905883789, "node_type": "broadwell" }, "time_duration_seconds": 23.0, "time_end": "2022-08-21T06:38:18+0000", "time_start": "2022-08-21T06:37:55+0000", "work_dir_size_gb": 0.804604159668088 }, "stage_in": { "exit_code": 0, "memory_max_gb": -999.0, "node": { "cores": 1, "disk_space_free_gb": 2381834.4552001953, "hostname": "r623i0n0.p4.nas.nasa.gov", "ip_address": "10.150.37.118", "memory_gb": 125.30337905883789, "node_type": "broadwell" }, "time_duration_seconds": 12.0, "time_end": "2022-08-21T06:37:55+0000", "time_start": "2022-08-21T06:37:43+0000", "work_dir_size_gb": 0.804604159668088 }, "stage_out": { "exit_code": 1, "memory_max_gb": -999.0, "node": { "cores": 1, "disk_space_free_gb": 2381834.4552001953, "hostname": "r623i0n0.p4.nas.nasa.gov", "ip_address": "10.150.37.118", "memory_gb": 125.30337905883789, "node_type": "broadwell" }, "time_duration_seconds": 4.0, "time_end": "2022-08-21T06:38:22+0000", "time_start": "2022-08-21T06:38:18+0000", "work_dir_size_gb": 0.804604159668088 }, "workflow": { "exit_code": 1, "memory_max_gb": -999.0, "node": { "cores": 1, "disk_space_free_gb": 2381834.4552001953, "hostname": "r623i0n0.p4.nas.nasa.gov", "ip_address": "10.150.37.118", "memory_gb": 125.30337905883789, "node_type": "broadwell" }, "time_duration_seconds": 39.0, "time_end": "2022-08-21T06:38:22+0000", "time_start": "2022-08-21T06:37:43+0000", "work_dir_size_gb": 2.413812479004264 } }, "status": "failed", "time_queued": "2022-08-21T06:36:52+0000", "username": "jjacob" } }

[jjacob7734]

Demoed in GEDI Subset jupyter notebook.