Internal server error on wf submit

Sometimes, when submitting a workflow, an error 500 is returned and displayed to the user as an alert. The workflow is actually successfully created by argo. Logs show:

----------------submit-------------------------
Starting new HTTPS connection (1): HOST:443
https://HOST:443 "POST /argowf/api/v1/workflows/argo HTTP/1.1" 200 None
Starting new HTTPS connection (1): HOST:443
https://HOST:443 "GET /argowf/api/v1/workflows/argo/n-a-a-vre-user-ngx5d HTTP/1.1
" 200 None
Internal Server Error: /vre-api/api/workflows/submit/
Traceback (most recent call last):
  File "/opt/venv/lib/python3.11/site-packages/django/core/handlers/exception.py", line 56, in inner
    response = get_response(request)
               ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.11/site-packages/django/core/handlers/base.py", line 197, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.11/site-packages/django/views/decorators/csrf.py", line 55, in wrapped_view
    return view_func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.11/site-packages/rest_framework/viewsets.py", line 125, in view
    return self.dispatch(request, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.11/site-packages/rest_framework/views.py", line 509, in dispatch
    response = self.handle_exception(exc)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
    self.raise_uncaught_exception(exc)
  File "/opt/venv/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_except
ion
    raise exc
  File "/opt/venv/lib/python3.11/site-packages/rest_framework/views.py", line 506, in dispatch
    response = handler(request, *args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/workflows/views.py", line 169, in submit
    'status': f"{resp_detail_data['status']['phase']} - {resp_detail_data['status']['progress']}",
                 ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
KeyError: 'phase'

QCDIS / VREPaaS

Internal server error on wf submit #185