Closed juchaosong closed 3 years ago
The node gems-wf-v0-8-21db1d4b-4a2c-40b0-8ebe-228d2f53d96e-504546219
's waiting message is message: 'Waiting for argo-hubble/ConfigMap/gems-sync/trucksim_regenarate_template lock. Lock status: 0/9 '
. But other synchronization. semaphore.holding.holders
is finished.
@juchaosong can you provide the workflow controller log?
Another wf.yaml
apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
annotations:
workflows.inceptio.ai/failed-channel: workflow-failed-dev
workflows.inceptio.ai/succeeded-channel: workflow-succeeded-dev
creationTimestamp: "2021-01-13T12:14:45Z"
generation: 57
labels:
workflows.argoproj.io/controller-instanceid: kraken-v2.12
workflows.argoproj.io/phase: Running
workflows.inceptio.ai/author: juchao.song
workflows.inceptio.ai/template: gems-wf-v0-8
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
namespace: argo-hubble
resourceVersion: "2466407581"
selfLink: /apis/argoproj.io/v1alpha1/namespaces/argo-hubble/workflows/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
uid: 68974504-8407-4ca4-be7b-2bef9d35fb04
spec:
arguments:
parameters:
- name: test_case_group
value: control_tests
- name: user
value: XiaoLing Li
- name: cybertron_commit_id
value: eeb8b1ccf2f95199cf0faeb52772c7ce8ad55a24
- name: cybertron_branch
value: master
- name: regression_commit_id
value: master
entrypoint: gems-entrypoint
onExit: exit-handler
parallelism: 100
synchronization:
semaphore:
configMapKeyRef:
key: gems_wf_limited
name: gems-sync
templates:
- arguments: {}
inputs: {}
metadata: {}
name: gems-entrypoint
outputs: {}
steps:
- - arguments: {}
continueOn:
failed: true
name: build-cybertron-pkg-step
template: build-cybertron-pkg
- arguments: {}
name: build-cybertron-sim-step
template: build-cybertron-sim
- arguments: {}
name: build-cybertron-sim-p1-step
template: build-cybertron-sim-p1
- arguments: {}
name: fetch-regression-repository-step
template: fetch-regression-repository
- - arguments: {}
name: fetch-test-group-step
template: fetch-test-group
- - arguments:
parameters:
- name: test_case_name
value: '{{item.test_case_name}}'
- name: gpu_requirement
value: '{{item.gpu_requirement}}'
- name: truck_sim
value: '{{item.truck_sim}}'
continueOn:
failed: true
name: regression-step
template: regression
withParam: '{{steps.fetch-test-group-step.outputs.result}}'
- - arguments: {}
continueOn:
failed: true
name: aggregation-step
template: aggregation
- - arguments: {}
name: ingest-step
template: ingest
- arguments: {}
inputs: {}
metadata: {}
name: exit-handler
outputs: {}
steps:
- - arguments: {}
name: celebrate
template: celebrate
when: '{{workflow.status}} == Succeeded'
- arguments: {}
name: cry
template: cry
when: '{{workflow.status}} != Succeeded'
- arguments: {}
inputs:
parameters:
- name: cybertron_commit_timestamp
value: '{{workflow.outputs.parameters.global_cybertron_commit_timestamp}}'
- name: cybertron_commit_author
value: '{{workflow.outputs.parameters.global_cybertron_commit_author}}'
metadata: {}
name: celebrate
outputs: {}
script:
command:
- bash
env:
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: CYBERTRON_BRANCH
value: '{{workflow.parameters.cybertron_branch}}'
- name: CYBERTRON_COMMIT_AUTHOR
value: '{{inputs.parameters.cybertron_commit_author}}'
- name: TEST_CASE_GROUP
value: '{{workflow.parameters.test_case_group}}'
- name: TRIGGER_USER
value: '{{workflow.parameters.user}}'
- name: GEMS_NOTIFY_WECHAT_URL
valueFrom:
configMapKeyRef:
key: gems_wechat_url
name: cluster-configs
- name: CHARIOT_WEB_HOST
valueFrom:
configMapKeyRef:
key: cht_web_host
name: cluster-configs
- name: GRAFANA_WEB_HOST
valueFrom:
configMapKeyRef:
key: grafana_web_host
name: cluster-configs
image: everpeace/curl-jq
name: ""
resources: {}
source: |
CHARIOT_URL="$CHARIOT_WEB_HOST/workflows/{{workflow.name}}"
GRAFANA_URL="${GRAFANA_WEB_HOST}/d/R6oDol5Gz/gems-metrics?orgId=1&var-branch=${CYBERTRON_BRANCH}&var-commitId=${CYBERTRON_COMMIT_ID}&var-workflow={{workflow.name}}&from=now-30d&to=now"
GRAFANA_WF_STATUS_URL="${GRAFANA_WEB_HOST}/d/ouaL2d2Mz/gems-workflows?orgId=1&var-workflow={{workflow.name}}"
curl -s "${GEMS_NOTIFY_WECHAT_URL}" \
-H 'Content-Type: application/json' \
-d '{
"msgtype": "markdown",
"markdown": {
"content": "<font color=\"info\">Regression test workflow succeed!!!</font>
> workflow_id:<font color=\"comment\">'"{{workflow.name}}"'</font>
> commit_id:<font color=\"comment\">'"${CYBERTRON_COMMIT_ID:-"UNKNOWN"}"'</font>
> branch:<font color=\"comment\">'"${CYBERTRON_BRANCH:-"UNKNOWN"}"'</font>
> author:<font color=\"comment\">'"${CYBERTRON_COMMIT_AUTHOR:-"UNKNOWN"}"'</font>
> user:<font color=\"comment\">'"${TRIGGER_USER:-"UNKNOWN"}"'</font>
> test_group:<font color=\"comment\">'"${TEST_CASE_GROUP:-"UNKNOWN"}"'</font>
[Chariot Link]('${CHARIOT_URL}')
[Grafana Link]('${GRAFANA_URL}')
[Grafana Workflow Status Link]('${GRAFANA_WF_STATUS_URL}')"
}
}'
volumeMounts:
- mountPath: /tmpdir
name: tmpdir
- arguments: {}
inputs:
parameters:
- name: cybertron_commit_timestamp
value: '{{workflow.outputs.parameters.global_cybertron_commit_timestamp}}'
- name: cybertron_commit_author
value: '{{workflow.outputs.parameters.global_cybertron_commit_author}}'
metadata: {}
name: cry
outputs: {}
script:
command:
- bash
env:
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: CYBERTRON_BRANCH
value: '{{workflow.parameters.cybertron_branch}}'
- name: CYBERTRON_COMMIT_AUTHOR
value: '{{inputs.parameters.cybertron_commit_author}}'
- name: TRIGGER_USER
value: '{{workflow.parameters.user}}'
- name: TEST_CASE_GROUP
value: '{{workflow.parameters.test_case_group}}'
- name: GEMS_NOTIFY_WECHAT_URL
valueFrom:
configMapKeyRef:
key: gems_wechat_url
name: cluster-configs
- name: CHARIOT_WEB_HOST
valueFrom:
configMapKeyRef:
key: cht_web_host
name: cluster-configs
image: everpeace/curl-jq
name: ""
resources: {}
source: |
CHARIOT_URL="$CHARIOT_WEB_HOST/workflows/{{workflow.name}}"
GRAFANA_WF_STATUS_URL="${GRAFANA_WEB_HOST}/d/ouaL2d2Mz/gems-workflows?orgId=1&var-workflow={{workflow.name}}"
curl -s "${GEMS_NOTIFY_WECHAT_URL}" -H 'Content-Type: application/json' \
-d '{
"msgtype": "markdown",
"markdown": {
"content": "<font color=\"warning\">Regression test workflow failed!!!</font>
> workflow_id:<font color=\"comment\">'"{{workflow.name}}"'</font>
> commit_id:<font color=\"comment\">'"${CYBERTRON_COMMIT_ID:-"UNKNOWN"}"'</font>
> branch:<font color=\"comment\">'"${CYBERTRON_BRANCH:-"UNKNOWN"}"'</font>
> author:<font color=\"comment\">'"${CYBERTRON_COMMIT_AUTHOR:-"UNKNOWN"}"'</font>
> user:<font color=\"comment\">'"${TRIGGER_USER:-"UNKNOWN"}"'</font>
> test_group:<font color=\"comment\">'"${TEST_CASE_GROUP:-"UNKNOWN"}"'</font>
Please refer: [Chariot Link]('${CHARIOT_URL}')
[Grafana Workflow Status Link]('${GRAFANA_WF_STATUS_URL}')"
}
}'
volumeMounts:
- mountPath: /tmpdir
name: tmpdir
- arguments: {}
inputs: {}
metadata: {}
name: build-cybertron-pkg
outputs:
parameters:
- globalName: global_cybertron_commit_timestamp
name: cybertron_commit_timestamp
valueFrom:
path: /tmpdir/cybertron_commit_timestamp.txt
- globalName: global_cybertron_commit_author
name: cybertron_commit_author
valueFrom:
path: /tmpdir/cybertron_commit_author.txt
- globalName: global_idl_version
name: idl_version
valueFrom:
path: /tmpdir/idl_version.txt
retryStrategy:
limit: 2
script:
command:
- bash
env:
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/sde_cybertron_release:2020_07_03_c12745f7
name: ""
resources: {}
source: |
set -ex
ssh-keyscan gitlab.rd.inceptioglobal.ai >> ~/.ssh/known_hosts
chmod 644 ~/.ssh/known_hosts
export HTTP_PROXY=http://gfw-proxy.inceptio.tech:8118
export HTTPS_PROXY=http://gfw-proxy.inceptio.tech:8118
export NO_PROXY=.cn,.aliyun.com,.aliyuncs.com,.chariot,.artifactory
mkdir -p /root/cybertron && cd /root/cybertron
git init
git remote add origin https://gitlab:$GITLAB_TOKEN@gitlab.rd.inceptioglobal.ai/autonomy/cybertron.git
git fetch --depth=1 origin $CYBERTRON_COMMIT_ID
git reset --hard FETCH_HEAD
echo "\"$(git show -s --format=%ct HEAD)\"" > /tmpdir/cybertron_commit_timestamp.txt
git show -s --format='%ae' HEAD > /tmpdir/cybertron_commit_author.txt
# FXIME: install empy when buiding image
pip3 install empy
# bazel build \
# --define tensorrt=default \
# --remote_cache=grpc://bb-storage.inceptio.tech:8980 \
# --remote_instance_name=cybertron \
# //:bin_pkg_tar //interfaces/tools/gems/pb_converter:all
# get idl version
if [ -f irs/common/recorder/idl_record_io.h ];then
IDL_RECORD_IO=irs/common/recorder/idl_record_io.h
else
IDL_RECORD_IO=bazel-cybertron/external/wheeljack_x86_64/irs/common/recorder/idl_record_io.h
fi
MAJOR=$(cat $IDL_RECORD_IO | sed -rn 's/^.*kCurrentRepoVersionMajor\ *=\ *([0-9]*);/\1/p')
MINOR=$(cat $IDL_RECORD_IO | sed -rn 's/^.*kCurrentRepoVersionMinor\ *=\ *([0-9]*);/\1/p')
IDL=$(cat $IDL_RECORD_IO | sed -rn 's/^.*kCurrentIdlHiddenVersion\ *=\ *([0-9]*);/\1/p')
echo ${MAJOR}.${MINOR}.${IDL} > /tmpdir/idl_version.txt
exit 0
cd ..
tar --exclude='cybertron/bazel-cybertron' \
--exclude='cybertron/bazel-out' \
-h -cf cybertron-pkg.tar cybertron
ls -alh cybertron-pkg.tar
cp cybertron-pkg.tar /data
volumeMounts:
- mountPath: /root/.jfrog/jfrog-cli.conf
name: credentials-volume
subPath: jfrog-cli.conf
- mountPath: /data
name: artifacts-volume-claim
- mountPath: /root/.ssh/id_rsa
name: gitlab-ssh-key-volume
subPath: id_rsa
- mountPath: /tmpdir
name: tmpdir
- arguments: {}
inputs: {}
metadata: {}
name: build-cybertron-sim
outputs: {}
retryStrategy:
limit: 2
script:
command:
- bash
env:
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/sde_cybertron_release:2020_07_03_c12745f7
name: ""
resources: {}
source: |
set -ex
exit 0
ssh-keyscan gitlab.rd.inceptioglobal.ai >> ~/.ssh/known_hosts
chmod 644 ~/.ssh/known_hosts
export HTTP_PROXY=http://gfw-proxy.inceptio.tech:8118
export HTTPS_PROXY=http://gfw-proxy.inceptio.tech:8118
export NO_PROXY=.cn,.aliyun.com,.aliyuncs.com,.chariot,.artifactory
mkdir -p /root/cybertron && cd /root/cybertron
git init
git remote add origin https://gitlab:$GITLAB_TOKEN@gitlab.rd.inceptioglobal.ai/autonomy/cybertron.git
git fetch --depth=1 origin $CYBERTRON_COMMIT_ID
git reset --hard FETCH_HEAD
# FXIME: install empy when buiding image
pip3 install empy
bazel build \
--define tensorrt=default \
--remote_cache=grpc://bb-storage.inceptio.tech:8980 \
--remote_instance_name=cybertron \
//simulation/launch:simulation_main --config=sim
bazel build \
--define tensorrt=default \
--remote_cache=grpc://bb-storage.inceptio.tech:8980 \
--remote_instance_name=cybertron \
//interfaces/tools/gems/pb_converter:all
cd ..
tar --exclude='cybertron/bazel-cybertron' \
--exclude='cybertron/bazel-out' \
-h -cf cybertron-sim.tar cybertron
ls -alh cybertron-sim.tar
cp cybertron-sim.tar /data
volumeMounts:
- mountPath: /root/.jfrog/jfrog-cli.conf
name: credentials-volume
subPath: jfrog-cli.conf
- mountPath: /data
name: artifacts-volume-claim
- mountPath: /root/.ssh/id_rsa
name: gitlab-ssh-key-volume
subPath: id_rsa
- arguments: {}
inputs: {}
metadata: {}
name: build-cybertron-sim-p1
outputs: {}
retryStrategy:
limit: 2
script:
command:
- bash
env:
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/sde_cybertron_release:2020_07_03_c12745f7
name: ""
resources: {}
source: |
set -ex
exit 0
ssh-keyscan gitlab.rd.inceptioglobal.ai >> ~/.ssh/known_hosts
chmod 644 ~/.ssh/known_hosts
export HTTP_PROXY=http://gfw-proxy.inceptio.tech:8118
export HTTPS_PROXY=http://gfw-proxy.inceptio.tech:8118
export NO_PROXY=.cn,.aliyun.com,.aliyuncs.com,.chariot,.artifactory
mkdir -p /root/cybertron && cd /root/cybertron
git init
git remote add origin https://gitlab:$GITLAB_TOKEN@gitlab.rd.inceptioglobal.ai/autonomy/cybertron.git
git fetch --depth=1 origin $CYBERTRON_COMMIT_ID
git reset --hard FETCH_HEAD
# FXIME: install empy when buiding image
pip3 install empy
bazel build \
--define tensorflow_target=p1 \
--remote_cache=grpc://bb-storage.inceptio.tech:8980 \
--remote_instance_name=cybertron \
//simulation/launch:simulation_main --config=sim
bazel build \
--define tensorflow_target=p1 \
--remote_cache=grpc://bb-storage.inceptio.tech:8980 \
--remote_instance_name=cybertron \
//interfaces/tools/gems/pb_converter:all
cd ..
tar --exclude='cybertron/bazel-cybertron' \
--exclude='cybertron/bazel-out' \
-h -cf cybertron-sim-p1.tar cybertron
ls -alh cybertron-sim-p1.tar
cp cybertron-sim-p1.tar /data
volumeMounts:
- mountPath: /root/.jfrog/jfrog-cli.conf
name: credentials-volume
subPath: jfrog-cli.conf
- mountPath: /data
name: artifacts-volume-claim
- mountPath: /root/.ssh/id_rsa
name: gitlab-ssh-key-volume
subPath: id_rsa
- arguments: {}
inputs: {}
metadata: {}
name: fetch-regression-repository
outputs: {}
retryStrategy:
limit: 2
retryPolicy: Always
script:
command:
- bash
env:
- name: REGRESSION_COMMIT_ID
value: '{{workflow.parameters.regression_commit_id}}'
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/sde_cybertron_release:2020_07_03_c12745f7
name: ""
resources: {}
source: |
set -ex
mkdir -p /data/regression && cd /data/regression
git init
git remote add origin https://gitlab:$GITLAB_TOKEN@gitlab.rd.inceptioglobal.ai/autonomy/regression.git
echo "$REGRESSION_COMMIT_ID"
git fetch --depth=1 origin $REGRESSION_COMMIT_ID
git reset --hard FETCH_HEAD
volumeMounts:
- mountPath: /data
name: artifacts-volume-claim
- arguments: {}
inputs: {}
metadata: {}
name: fetch-test-group
outputs: {}
script:
command:
- bash
env:
- name: TEST_CASE_GROUP
value: '{{workflow.parameters.test_case_group}}'
- name: REGRESSION_PATH
value: /data/regression
image: everpeace/curl-jq
name: ""
resources: {}
source: |
set -e
trim_prefix_suffix_slash(){ sed -e 's/^\///' -e 's/\/$//'; }
cd $REGRESSION_PATH
mkdir -p /data/test_cases_result/
ls -F -d ${TEST_CASE_GROUP}/* \
| grep '/$' | trim_prefix_suffix_slash > /data/test_cases_result/tmp_testcases
echo '[]' > /data/test_cases_result/test_case_result.json
for line in `cat /data/test_cases_result/tmp_testcases`
do
if cat $line/gems_task_v2.pb.txt | grep "disable" &> /dev/null; then
continue
fi
gpu_requirement=$(cat $line/gems_task_v2.pb.txt | grep num_gpu_required | sed -e 's/ //' -e 's/num_gpu_required://')
if [ -z "$gpu_requirement" ]; then
gpu_requirement="0"
fi
truck_sim="$(cat $line/gems_task_v2.pb.txt | grep 'use_trucksim: true' || true )"
if [ -z "$truck_sim" ]; then
truck_sim="false"
else
truck_sim="true"
fi
echo "[{ \"gpu_requirement\": \"$gpu_requirement\", \"test_case_name\":\"$line\", \"truck_sim\":\"$truck_sim\" }]" \
| jq ".+= $(cat /data/test_cases_result/test_case_result.json)" > /data/test_cases_result/test_case_result.json
done
cat /data/test_cases_result/test_case_result.json | sed -e 's/ //' -e 's/\n//'
volumeMounts:
- mountPath: /data
name: artifacts-volume-claim
- arguments: {}
inputs:
parameters:
- name: test_case_name
- name: gpu_requirement
- name: truck_sim
metadata: {}
name: regression
outputs: {}
steps:
- - arguments:
parameters:
- name: test_case_name
value: '{{inputs.parameters.test_case_name}}'
name: regenerate-step
template: regenerate
when: '{{inputs.parameters.gpu_requirement}} == 0 && {{inputs.parameters.truck_sim}}
!= true'
- arguments:
parameters:
- name: test_case_name
value: '{{inputs.parameters.test_case_name}}'
name: regenerate-trucksim-step
template: regenerate-trucksim
when: '{{inputs.parameters.gpu_requirement}} == 0 && {{inputs.parameters.truck_sim}}
== true'
- arguments:
parameters:
- name: test_case_name
value: '{{inputs.parameters.test_case_name}}'
name: regenerate-gpu-step
template: regenerate-gpu
when: '{{inputs.parameters.gpu_requirement}} != 0 && {{inputs.parameters.truck_sim}}
!= true'
- arguments:
parameters:
- name: test_case_name
value: '{{inputs.parameters.test_case_name}}'
name: regenerate-trucksim-gpu-step
template: regenerate-trucksim-gpu
when: '{{inputs.parameters.gpu_requirement}} != 0 && {{inputs.parameters.truck_sim}}
== true'
- - arguments:
parameters:
- name: test_case_name
value: '{{inputs.parameters.test_case_name}}'
name: evaluate-step
template: evaluate
- arguments: {}
inputs:
parameters:
- name: test_case_name
metadata:
annotations:
k8s.aliyun.com/eci-image-cache: "true"
k8s.aliyun.com/eci-use-specs: ecs.ic5.large
name: regenerate
nodeSelector:
type: virtual-kubelet
outputs: {}
retryStrategy:
limit: 2
retryPolicy: Always
script:
command:
- bash
env:
- name: TEST_CASE_NAME
value: '{{inputs.parameters.test_case_name}}'
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: REGENERATED_BUCKET
valueFrom:
configMapKeyRef:
key: moment_regenerated_oss_bucket
name: cluster-configs
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
- name: CAS_TOKEN
valueFrom:
secretKeyRef:
key: token
name: cas-service-token
- name: ENV
valueFrom:
configMapKeyRef:
key: env
name: cluster-configs
- name: CAS_WEB_HOST
valueFrom:
configMapKeyRef:
key: cas_web_host
name: cluster-configs
- name: CHT_GATEWAY_HOST
valueFrom:
configMapKeyRef:
key: cht_gateway_host
name: cluster-configs
- name: RT_CN_WEB_URL
valueFrom:
configMapKeyRef:
key: rt_cn_web_url
name: cluster-configs
- name: RT_US_WEB_URL
valueFrom:
configMapKeyRef:
key: rt_us_web_url
name: cluster-configs
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/infra_regenerate-gems:v20210105-5044b06
name: ""
resources: {}
source: |
set -ex
T0=$(date +%s)
cat_gems_task_pbtxt(){ cat /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt; }
trim_prefix_suffix_quote(){ sed -e 's/^"//' -e 's/"$//'; }
LAUNCH_NAME=$(cat_gems_task_pbtxt | grep launch_config_rel_path | awk '{print$2}' | trim_prefix_suffix_quote)
VEHICLE_ID=$(cat_gems_task_pbtxt | grep vehicle_id | awk '{print$2}' | trim_prefix_suffix_quote)
MAP=$(cat_gems_task_pbtxt | grep map_version | awk '{print$2}' | trim_prefix_suffix_quote)
TIMEOUT=$(cat_gems_task_pbtxt | grep timeout_sec | awk '{print$2}')
MOMENT_ID=$(cat_gems_task_pbtxt | grep moment_id | awk '{print$2}' | trim_prefix_suffix_quote)
SIM_MODE=$(cat_gems_task_pbtxt | grep "sim_mode:" | awk '{print$2}')
REC_REL_DIR=$(cat_gems_task_pbtxt | grep "rec_rel_dir:" | awk '{print$2}' | trim_prefix_suffix_quote)
if [[ $SIM_MODE == "IDEAL" || $SIM_MODE == "WORLD" ]]; then
CYBERTRON_TAR=cybertron-sim.tar
elif [[ $SIM_MODE == "TIMELY" ]]; then
CYBERTRON_TAR=cybertron-pkg.tar
else
echo "Unsupported sim_mode $SIM_MODE"
exit 1
fi
T1=$(date +%s)
echo "Parse parameters took $((T1-T0)) seconds"
cp /data/$CYBERTRON_TAR /root/cybertron.tar && cd /root && tar -xf cybertron.tar && rm cybertron.tar && cd cybertron
T2=$(date +%s)
echo "Copy tar took $((T2-T1)) seconds"
if [[ ! -z "$MOMENT_ID" ]]; then
dataset client \
dl moments/$MOMENT_ID \
--token=$CAS_TOKEN \
--target=dataset-server.chariot:50050 \
--dataset-process-target=dataset-server.chariot:50051 \
--target-path=/root/moments/$REC_REL_DIR \
--idl-version={{workflow.outputs.parameters.global_idl_version}}
fi
T3=$(date +%s)
echo "Downloading data took $((T3-T2)) seconds"
# Detect in kube pods
sed -i "s/docker/kubepods/#g" /root/cybertron/irs/process_manager/setup/ubuntu_x86_64/ipm_u_setup.sh
# Set chariot env
#export CHARIOT_ENV=$(echo $ENV | tr 'a-z' 'A-Z')
export CHARIOT_SITE=cn
cat <<EOF >> chariot_config.json
{
"CAS_URL": "$CAS_WEB_HOST",
"CHARIOT_SERVER_URL": "$CHT_GATEWAY_HOST",
"artifacts": {
"us": {
"endpoint": "$RT_US_WEB_URL",
"repo_type": "local"
},
"cn": {
"endpoint": "$RT_CN_WEB_URL",
"repo_type": "remote"
}
}
}
EOF
export CHARIOT_ENV_FILE=chariot_config.json
chariot -t $CAS_TOKEN -o json config --set disable_auto_update=true
if [[ $SIM_MODE == "IDEAL" || $SIM_MODE == "WORLD" ]]; then
if [[ $SIM_MODE == "IDEAL" ]]; then
# gems-sim use the rec pattern
mv /root/moments/$TEST_CASE_NAME/${MOMENT_ID:0:2}/$MOMENT_ID/* /root/moments/$TEST_CASE_NAME
fi
# gems-sim not untar the packages
yq delete -i bundle.yaml packages.cybertron.build.tars
yq delete -i bundle.yaml packages.cybertron.deployScript
cat bundle.yaml
chariot -t $CAS_TOKEN deploy -f bundle.yaml
T4=$(date +%s)
echo "Chariot deploy took $((T4-T3)) seconds"
if [ -f /data/regression/$TEST_CASE_NAME/input_command.pb.txt ]; then
INPUT_COMMAND_LIST_PARAM="-l /data/regression/$TEST_CASE_NAME/input_command.pb.txt"
fi
echo "MOMENT_ID: $MOMENT_ID"
LD_LIBRARY_PATH=/usr/local/cuda/lib64:/usr/local/cuda/compat:/usr/lib/x86_64-linux-gnu/:$LD_LIBRARY_PATH
cd /root/cybertron/
timeout $TIMEOUT bazel-bin/simulation/launch/simulation_main --config_path /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt \
--no_ui \
--data_path /root/moments/ \
--output_path /root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID
cd -
T5=$(date +%s)
echo "Gems sim took $((T5-T4)) seconds"
elif [[ $SIM_MODE == "TIMELY" ]]; then
pip3 install irs/launch/launch irs/launch/launch_ros irs/launch/launch_yaml irs/launch/test_launch_ros irs/launch/osrf_pycommon
chariot -t $CAS_TOKEN replay \
--no-check \
--launch \
--name=$LAUNCH_NAME \
--file=bundle.yaml \
--map=$MAP \
--vehicle-id=$VEHICLE_ID \
--timeout=$TIMEOUT \
--replay-rec-path=/root/moments/$REC_REL_DIR/${MOMENT_ID:0:2}/$MOMENT_ID \
--output=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID
T5=$(date +%s)
echo "time sync replayer took $((T5-T3)) seconds"
fi
gems-rec-convert \
--exec_path=/root/cybertron \
--input_path=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/rec \
--output_path=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/pb
T6=$(date +%s)
echo "Converter took $((T6-T5)) seconds"
mkdir -p /data/$TEST_CASE_NAME/regenerated/pb
cp -a /root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/pb /data/$TEST_CASE_NAME/regenerated
if [[ $SIM_MODE == "IDEAL" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/${MOMENT_ID:0:2}/$MOMENT_ID/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID"
elif [[ $SIM_MODE == "WORLD" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID"
elif [[ $SIM_MODE == "TIMELY" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/${MOMENT_ID:0:2}/$MOMENT_ID/$LAUNCH_NAME/$CYBERTRON_COMMIT_ID"
fi
# calculate disk storage
du -hd 1 /root
ls -l /root/cybertron || true
du -hd 1 /root/cybertron
ossutil cp --config-file=/root/.ossutilconfig -r -f \
/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID \
$OSS_DEST_PATH
T7=$(date +%s)
echo "Oss copy took $((T6-T5)) seconds"
volumeMounts:
- mountPath: /root/.jfrog/jfrog-cli.conf
name: credentials-volume
subPath: jfrog-cli.conf
- mountPath: /root/.ossutilconfig
name: credentials-volume
subPath: .ossutilconfig
- mountPath: /data
name: artifacts-volume-claim
tolerations:
- key: virtual-kubelet.io/provider
operator: Exists
- arguments: {}
inputs:
parameters:
- name: test_case_name
metadata:
annotations:
k8s.aliyun.com/eci-image-cache: "true"
k8s.aliyun.com/eci-use-specs: ecs.ic5.large
name: regenerate-trucksim
nodeSelector:
type: virtual-kubelet
outputs: {}
retryStrategy:
limit: 2
retryPolicy: Always
script:
command:
- bash
env:
- name: TEST_CASE_NAME
value: '{{inputs.parameters.test_case_name}}'
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: REGENERATED_BUCKET
valueFrom:
configMapKeyRef:
key: moment_regenerated_oss_bucket
name: cluster-configs
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
- name: CAS_TOKEN
valueFrom:
secretKeyRef:
key: token
name: cas-service-token
- name: ENV
valueFrom:
configMapKeyRef:
key: env
name: cluster-configs
- name: CAS_WEB_HOST
valueFrom:
configMapKeyRef:
key: cas_web_host
name: cluster-configs
- name: CHT_GATEWAY_HOST
valueFrom:
configMapKeyRef:
key: cht_gateway_host
name: cluster-configs
- name: RT_CN_WEB_URL
valueFrom:
configMapKeyRef:
key: rt_cn_web_url
name: cluster-configs
- name: RT_US_WEB_URL
valueFrom:
configMapKeyRef:
key: rt_us_web_url
name: cluster-configs
- name: TS_LICENSE_SERVER
valueFrom:
configMapKeyRef:
key: ts_license_server
name: cluster-configs
- name: TS_LICENSE_TYPE
valueFrom:
configMapKeyRef:
key: ts_license_type
name: cluster-configs
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/infra_regenerate-gems:v20210105-5044b06
name: ""
resources: {}
source: |
set -ex
exit 0
T0=$(date +%s)
cat_gems_task_pbtxt(){ cat /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt; }
trim_prefix_suffix_quote(){ sed -e 's/^"//' -e 's/"$//'; }
LAUNCH_NAME=$(cat_gems_task_pbtxt | grep launch_config_rel_path | awk '{print$2}' | trim_prefix_suffix_quote)
VEHICLE_ID=$(cat_gems_task_pbtxt | grep vehicle_id | awk '{print$2}' | trim_prefix_suffix_quote)
MAP=$(cat_gems_task_pbtxt | grep map_version | awk '{print$2}' | trim_prefix_suffix_quote)
TIMEOUT=$(cat_gems_task_pbtxt | grep timeout_sec | awk '{print$2}')
MOMENT_ID=$(cat_gems_task_pbtxt | grep moment_id | awk '{print$2}' | trim_prefix_suffix_quote)
SIM_MODE=$(cat_gems_task_pbtxt | grep "sim_mode:" | awk '{print$2}')
REC_REL_DIR=$(cat_gems_task_pbtxt | grep "rec_rel_dir:" | awk '{print$2}' | trim_prefix_suffix_quote)
T1=$(date +%s)
echo "Parse parameters took $((T1-T0)) seconds"
if [[ $SIM_MODE == "IDEAL" || $SIM_MODE == "WORLD" ]]; then
CYBERTRON_TAR=cybertron-sim-p1.tar
elif [[ $SIM_MODE == "TIMELY" ]]; then
CYBERTRON_TAR=cybertron-pkg.tar
else
echo "Unsupported sim_mode $SIM_MODE"
exit 1
fi
cp /data/$CYBERTRON_TAR /root/cybertron.tar && cd /root && tar -xf cybertron.tar && rm cybertron.tar && cd cybertron
T2=$(date +%s)
echo "copy tar took $((T2-T1)) seconds"
if [[ ! -z "$MOMENT_ID" ]]; then
dataset client \
dl moments/$MOMENT_ID \
--token=$CAS_TOKEN \
--target=dns:///dataset-server-headless.chariot:50050 \
--dataset-process-target=dns:///dataset-server-headless.chariot:50051 \
--target-path=/root/moments/$REC_REL_DIR \
--idl-version={{workflow.outputs.parameters.global_idl_version}}
fi
T3=$(date +%s)
echo "Download data took $((T3-T2)) seconds"
# Detect in kube pods
sed -i "s/docker/kubepods/#g" /root/cybertron/irs/process_manager/setup/ubuntu_x86_64/ipm_u_setup.sh
# Set chariot env
#export CHARIOT_ENV=$(echo $ENV | tr 'a-z' 'A-Z')
export CHARIOT_SITE=cn
cat <<EOF >> chariot_config.json
{
"CAS_URL": "$CAS_WEB_HOST",
"CHARIOT_SERVER_URL": "$CHT_GATEWAY_HOST",
"artifacts": {
"us": {
"endpoint": "$RT_US_WEB_URL",
"repo_type": "local"
},
"cn": {
"endpoint": "$RT_CN_WEB_URL",
"repo_type": "remote"
}
}
}
EOF
export CHARIOT_ENV_FILE=chariot_config.json
chariot -t $CAS_TOKEN -o json config --set disable_auto_update=true
if [[ $SIM_MODE == "IDEAL" || $SIM_MODE == "WORLD" ]]; then
if [[ $SIM_MODE == "IDEAL" ]]; then
# gems-sim use the rec pattern
mv /root/moments/$REC_REL_DIR/${MOMENT_ID:0:2}/$MOMENT_ID/* /root/moments/$REC_REL_DIR
fi
# gems-sim not untar the packages
yq delete -i bundle.yaml packages.cybertron.build.tars
yq delete -i bundle.yaml packages.cybertron.deployScript
cat bundle.yaml
chariot -t $CAS_TOKEN deploy -f bundle.yaml
T4=$(date +%s)
echo "chariot deploy took $((T4-T3)) seconds"
if [ -f /data/regression/$TEST_CASE_NAME/input_command.pb.txt ]; then
INPUT_COMMAND_LIST_PARAM="-l /data/regression/$TEST_CASE_NAME/input_command.pb.txt"
fi
#FIXME: force using the 395 calibration for trucksim, for long term will using the gems_task setting or maintain a realtion map between vehicle model and platform(vehicle data/calibration)
ls /root/cybertron/config/calibration/CN_395
export IRS_CALIBRATION_PATH=/root/cybertron/config/calibration/CN_395
echo "MOMENT_ID: $MOMENT_ID"
LD_LIBRARY_PATH=/usr/local/cuda/lib64:/usr/local/cuda/compat:/usr/lib/x86_64-linux-gnu/:$LD_LIBRARY_PATH
cd /root/cybertron/
# Run truck sim
# trucksim found this this .so in absolute path
mkdir -p bazel-cybertron/../../external/trucksim_api/
cp /opt/trucksim_2020.0/lib64/libtrucksim.so.2020.0 bazel-cybertron/../../external/trucksim_api/libtrucksim.so.2020.0
T5=$(date +%s)
echo "Prepare trucksim took $((T5-T4)) seconds"
timeout $TIMEOUT bazel-bin/simulation/launch/simulation_main --config_path /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt \
--no_ui \
--data_path /root/moments/ \
--output_path /root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID
cd -
T6=$(date +%s)
echo "Gems-sim took $((T6-T5)) seconds"
elif [[ $SIM_MODE == "TIMELY" ]]; then
pip3 install irs/launch/launch irs/launch/launch_ros irs/launch/launch_yaml irs/launch/test_launch_ros irs/launch/osrf_pycommon
chariot -t $CAS_TOKEN replay \
--no-check \
--launch \
--name=$LAUNCH_NAME \
--file=bundle.yaml \
--map=$MAP \
--vehicle-id=$VEHICLE_ID \
--timeout=$TIMEOUT \
--replay-rec-path=/root/moments/$REC_REL_DIR/${MOMENT_ID:0:2}/$MOMENT_ID \
--output=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID
T6=$(date +%s)
echo "chariot replay took $((T6-T4)) seconds"
fi
cat /tmp/sim_log.txt || true
gems-rec-convert \
--exec_path=/root/cybertron \
--input_path=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/rec \
--output_path=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/pb
T7=$(date +%s)
echo "converter took $((T7-T6)) seconds"
mkdir -p /data/$TEST_CASE_NAME/regenerated/pb
cp -a /root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/pb /data/$TEST_CASE_NAME/regenerated
ls -l /data/$TEST_CASE_NAME/regenerated
if [[ $SIM_MODE == "IDEAL" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/${MOMENT_ID:0:2}/$MOMENT_ID/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID"
elif [[ $SIM_MODE == "WORLD" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID"
elif [[ $SIM_MODE == "TIMELY" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/${MOMENT_ID:0:2}/$MOMENT_ID/$LAUNCH_NAME/$CYBERTRON_COMMIT_ID"
fi
# calculate disk storage
du -hd 1 /root
ls -l /root/cybertron || true
du -hd 1 /root/cybertron
ossutil cp --config-file=/root/.ossutilconfig -r -f \
/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID \
$OSS_DEST_PATH
T8=$(date +%s)
echo "oss copy took $((T8-T7)) seconds"
volumeMounts:
- mountPath: /root/.jfrog/jfrog-cli.conf
name: credentials-volume
subPath: jfrog-cli.conf
- mountPath: /root/.ossutilconfig
name: credentials-volume
subPath: .ossutilconfig
- mountPath: /data
name: artifacts-volume-claim
synchronization:
semaphore:
configMapKeyRef:
key: trucksim_regenarate_template
name: gems-sync
tolerations:
- key: virtual-kubelet.io/provider
operator: Exists
- arguments: {}
inputs:
parameters:
- name: test_case_name
metadata:
annotations:
k8s.aliyun.com/eci-image-cache: "true"
k8s.aliyun.com/eci-use-specs: ecs.gn6i-c8g1.2xlarge
name: regenerate-gpu
nodeSelector:
type: virtual-kubelet
outputs: {}
retryStrategy:
backoff:
duration: 1m
factor: 1
maxDuration: 30m
limit: 2
retryPolicy: Always
script:
command:
- bash
env:
- name: TEST_CASE_NAME
value: '{{inputs.parameters.test_case_name}}'
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: REGENERATED_BUCKET
valueFrom:
configMapKeyRef:
key: moment_regenerated_oss_bucket
name: cluster-configs
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
- name: CAS_TOKEN
valueFrom:
secretKeyRef:
key: token
name: cas-service-token
- name: ENV
valueFrom:
configMapKeyRef:
key: env
name: cluster-configs
- name: CAS_WEB_HOST
valueFrom:
configMapKeyRef:
key: cas_web_host
name: cluster-configs
- name: CHT_GATEWAY_HOST
valueFrom:
configMapKeyRef:
key: cht_gateway_host
name: cluster-configs
- name: RT_CN_WEB_URL
valueFrom:
configMapKeyRef:
key: rt_cn_web_url
name: cluster-configs
- name: RT_US_WEB_URL
valueFrom:
configMapKeyRef:
key: rt_us_web_url
name: cluster-configs
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/infra_regenerate-gems:v20210105-5044b06
name: ""
resources:
limits:
nvidia.com/gpu: "1"
source: |
set -ex
cat_gems_task_pbtxt(){ cat /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt; }
trim_prefix_suffix_quote(){ sed -e 's/^"//' -e 's/"$//'; }
LAUNCH_NAME=$(cat_gems_task_pbtxt | grep launch_config_rel_path | awk '{print$2}' | trim_prefix_suffix_quote)
VEHICLE_ID=$(cat_gems_task_pbtxt | grep vehicle_id | awk '{print$2}' | trim_prefix_suffix_quote)
MAP=$(cat_gems_task_pbtxt | grep map_version | awk '{print$2}' | trim_prefix_suffix_quote)
TIMEOUT=$(cat_gems_task_pbtxt | grep timeout_sec | awk '{print$2}')
MOMENT_ID=$(cat_gems_task_pbtxt | grep moment_id | awk '{print$2}' | trim_prefix_suffix_quote)
SIM_MODE=$(cat_gems_task_pbtxt | grep sim_mode | awk '{print$2}')
REC_REL_DIR=$(cat_gems_task_pbtxt | grep "rec_rel_dir:" | awk '{print$2}' | trim_prefix_suffix_quote)
if [[ $SIM_MODE == "IDEAL" || $SIM_MODE == "WORLD" ]]; then
CYBERTRON_TAR=cybertron-sim.tar
elif [[ $SIM_MODE == "TIMELY" ]]; then
CYBERTRON_TAR=cybertron-pkg.tar
else
echo "Unsupported sim_mode $SIM_MODE"
exit 1
fi
cp /data/$CYBERTRON_TAR /root/cybertron.tar && cd /root && tar -xf cybertron.tar && rm cybertron.tar && cd cybertron
if [[ ! -z "$MOMENT_ID" ]]; then
dataset client \
dl moments/$MOMENT_ID \
--token=$CAS_TOKEN \
--target=dns:///dataset-server-headless.chariot:50050 \
--dataset-process-target=dns:///dataset-server-headless.chariot:50051 \
--target-path=/root/moments/$REC_REL_DIR \
--idl-version={{workflow.outputs.parameters.global_idl_version}}
fi
# Detect in kube pods
sed -i "s/docker/kubepods/#g" /root/cybertron/irs/process_manager/setup/ubuntu_x86_64/ipm_u_setup.sh
# Set chariot env
# export CHARIOT_ENV=$(echo $ENV | tr 'a-z' 'A-Z')
export CHARIOT_SITE=cn
cat <<EOF >> chariot_config.json
{
"CAS_URL": "$CAS_WEB_HOST",
"CHARIOT_SERVER_URL": "$CHT_GATEWAY_HOST",
"artifacts": {
"us": {
"endpoint": "$RT_US_WEB_URL",
"repo_type": "local"
},
"cn": {
"endpoint": "$RT_CN_WEB_URL",
"repo_type": "remote"
}
}
}
EOF
export CHARIOT_ENV_FILE=chariot_config.json
chariot -o json config --set disable_auto_update=true
if [[ $SIM_MODE == "IDEAL" || $SIM_MODE == "WORLD" ]]; then
if [[ $SIM_MODE == "IDEAL" ]]; then
# gems-sim use the rec pattern
mv /root/moments/$REC_REL_DIR/${MOMENT_ID:0:2}/$MOMENT_ID/* /root/moments/$REC_REL_DIR
fi
# gems-sim not untar the packages
yq delete -i bundle.yaml packages.cybertron.build.tars
yq delete -i bundle.yaml packages.cybertron.deployScript
cat bundle.yaml
chariot -t $CAS_TOKEN deploy -f bundle.yaml
if [ -f /data/regression/$TEST_CASE_NAME/input_command.pb.txt ]; then
INPUT_COMMAND_LIST_PARAM="-l /data/regression/$TEST_CASE_NAME/input_command.pb.txt"
fi
cd /root/cybertron/
timeout $TIMEOUT bazel-bin/simulation/launch/simulation_main --config_path /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt \
--no_ui \
--data_path /root/moments/ \
--output_path /root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID
cd -
elif [[ $SIM_MODE == "TIMELY" ]]; then
pip3 install irs/launch/launch irs/launch/launch_ros irs/launch/launch_yaml irs/launch/test_launch_ros irs/launch/osrf_pycommon
chariot -t $CAS_TOKEN replay \
--no-check \
--launch \
--name=$LAUNCH_NAME \
--file=bundle.yaml \
--map=$MAP \
--vehicle-id=$VEHICLE_ID \
--timeout=$TIMEOUT \
--replay-rec-path=/root/moments/$REC_REL_DIR/${MOMENT_ID:0:2}/$MOMENT_ID \
--output=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID
fi
gems-rec-convert \
--exec_path=/root/cybertron \
--input_path=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/rec \
--output_path=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/pb
mkdir -p /data/$TEST_CASE_NAME/regenerated/pb
cp -a /root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/pb /data/$TEST_CASE_NAME/regenerated
if [[ $SIM_MODE == "IDEAL" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/${MOMENT_ID:0:2}/$MOMENT_ID/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID"
elif [[ $SIM_MODE == "WORLD" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID"
elif [[ $SIM_MODE == "TIMELY" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/${MOMENT_ID:0:2}/$MOMENT_ID/$LAUNCH_NAME/$CYBERTRON_COMMIT_ID"
fi
# calculate disk storage
du -hd 1 /root
ls -l /root/cybertron || true
du -hd 1 /root/cybertron
ossutil cp --config-file=/root/.ossutilconfig -r -f \
/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID \
$OSS_DEST_PATH
volumeMounts:
- mountPath: /root/.jfrog/jfrog-cli.conf
name: credentials-volume
subPath: jfrog-cli.conf
- mountPath: /root/.ossutilconfig
name: credentials-volume
subPath: .ossutilconfig
- mountPath: /data
name: artifacts-volume-claim
tolerations:
- key: virtual-kubelet.io/provider
operator: Exists
- affinity:
nodeAffinity:
preferredDuringSchedulingIgnoredDuringExecution:
- preference:
matchExpressions:
- key: gpu_node
operator: In
values:
- "true"
weight: 100
arguments: {}
inputs:
parameters:
- name: test_case_name
metadata:
annotations:
k8s.aliyun.com/eci-image-cache: "true"
k8s.aliyun.com/eci-use-specs: ecs.gn6i-c8g1.2xlarge
name: regenerate-trucksim-gpu
outputs: {}
retryStrategy:
backoff:
duration: 1m
factor: 1
maxDuration: 30m
limit: 2
retryPolicy: Always
script:
command:
- bash
env:
- name: TEST_CASE_NAME
value: '{{inputs.parameters.test_case_name}}'
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: REGENERATED_BUCKET
valueFrom:
configMapKeyRef:
key: moment_regenerated_oss_bucket
name: cluster-configs
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
- name: CAS_TOKEN
valueFrom:
secretKeyRef:
key: token
name: cas-service-token
- name: ENV
valueFrom:
configMapKeyRef:
key: env
name: cluster-configs
- name: CAS_WEB_HOST
valueFrom:
configMapKeyRef:
key: cas_web_host
name: cluster-configs
- name: CHT_GATEWAY_HOST
valueFrom:
configMapKeyRef:
key: cht_gateway_host
name: cluster-configs
- name: RT_CN_WEB_URL
valueFrom:
configMapKeyRef:
key: rt_cn_web_url
name: cluster-configs
- name: RT_US_WEB_URL
valueFrom:
configMapKeyRef:
key: rt_us_web_url
name: cluster-configs
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/infra_regenerate-gems:v20210105-5044b06
name: ""
resources:
limits:
nvidia.com/gpu: "1"
source: |
set -ex
cat_gems_task_pbtxt(){ cat /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt; }
trim_prefix_suffix_quote(){ sed -e 's/^"//' -e 's/"$//'; }
LAUNCH_NAME=$(cat_gems_task_pbtxt | grep launch_config_rel_path | awk '{print$2}' | trim_prefix_suffix_quote)
VEHICLE_ID=$(cat_gems_task_pbtxt | grep vehicle_id | awk '{print$2}' | trim_prefix_suffix_quote)
MAP=$(cat_gems_task_pbtxt | grep map_version | awk '{print$2}' | trim_prefix_suffix_quote)
TIMEOUT=$(cat_gems_task_pbtxt | grep timeout_sec | awk '{print$2}')
MOMENT_ID=$(cat_gems_task_pbtxt | grep moment_id | awk '{print$2}' | trim_prefix_suffix_quote)
SIM_MODE=$(cat_gems_task_pbtxt | grep sim_mode | awk '{print$2}')
REC_REL_DIR=$(cat_gems_task_pbtxt | grep "rec_rel_dir:" | awk '{print$2}' | trim_prefix_suffix_quote)
if [[ $SIM_MODE == "IDEAL" || $SIM_MODE == "WORLD" ]]; then
CYBERTRON_TAR=cybertron-sim.tar
elif [[ $SIM_MODE == "TIMELY" ]]; then
CYBERTRON_TAR=cybertron-pkg.tar
else
echo "Unsupported sim_mode $SIM_MODE"
exit 1
fi
cp /data/$CYBERTRON_TAR /root/cybertron.tar && cd /root && tar -xf cybertron.tar && rm cybertron.tar && cd cybertron
if [[ ! -z "$MOMENT_ID" ]]; then
dataset client \
dl moments/$MOMENT_ID \
--token=$CAS_TOKEN \
--target=dns:///dataset-server-headless.chariot:50050 \
--dataset-process-target=dns:///dataset-server-headless.chariot:50051 \
--target-path=/root/moments/$REC_REL_DIR \
--idl-version={{workflow.outputs.parameters.global_idl_version}}
fi
# Detect in kube pods
sed -i "s/docker/kubepods/#g" /root/cybertron/irs/process_manager/setup/ubuntu_x86_64/ipm_u_setup.sh
# Set chariot env
# export CHARIOT_ENV=$(echo $ENV | tr 'a-z' 'A-Z')
export CHARIOT_SITE=cn
cat <<EOF >> chariot_config.json
{
"CAS_URL": "$CAS_WEB_HOST",
"CHARIOT_SERVER_URL": "$CHT_GATEWAY_HOST",
"artifacts": {
"us": {
"endpoint": "$RT_US_WEB_URL",
"repo_type": "local"
},
"cn": {
"endpoint": "$RT_CN_WEB_URL",
"repo_type": "remote"
}
}
}
EOF
export CHARIOT_ENV_FILE=chariot_config.json
chariot -t $CAS_TOKEN -o json config --set disable_auto_update=true
if [[ $SIM_MODE == "IDEAL" || $SIM_MODE == "WORLD" ]]; then
if [[ $SIM_MODE == "IDEAL" ]]; then
# gems-sim use the rec pattern
mv /root/moments/$REC_REL_DIR/${MOMENT_ID:0:2}/$MOMENT_ID/* /root/moments/$REC_REL_DIR
fi
# gems-sim not untar the packages
yq delete -i bundle.yaml packages.cybertron.build.tars
yq delete -i bundle.yaml packages.cybertron.deployScript
cat bundle.yaml
chariot -t $CAS_TOKEN deploy -f bundle.yaml
if [ -f /data/regression/$TEST_CASE_NAME/input_command.pb.txt ]; then
INPUT_COMMAND_LIST_PARAM="-l /data/regression/$TEST_CASE_NAME/input_command.pb.txt"
fi
#FIXME: force using the 395 calibration for trucksim, for long term will using the gems_task setting or maintain a realtion map between vehicle model and platform(vehicle data/calibration)
ls /root/cybertron/config/calibration/CN_395
export IRS_CALIBRATION_PATH=/root/cybertron/config/calibration/CN_395
cd /root/cybertron/
# Run truck sim
# trucksim found this this .so in absolute path
mkdir -p bazel-cybertron/../../external/trucksim_api/
cp /opt/trucksim_2020.0/lib64/libtrucksim.so.2020.0 bazel-cybertron/../../external/trucksim_api/libtrucksim.so.2020.0
timeout $TIMEOUT bazel-bin/simulation/launch/simulation_main --config_path /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt \
--no_ui \
--data_path /root/moments/ \
--output_path /root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID
cd -
elif [[ $SIM_MODE == "TIMELY" ]]; then
pip3 install irs/launch/launch irs/launch/launch_ros irs/launch/launch_yaml irs/launch/test_launch_ros irs/launch/osrf_pycommon
chariot -t $CAS_TOKEN replay \
--no-check \
--launch \
--name=$LAUNCH_NAME \
--file=bundle.yaml \
--map=$MAP \
--vehicle-id=$VEHICLE_ID \
--timeout=$TIMEOUT \
--replay-rec-path=/root/moments/$TEST_CASE_NAME/${MOMENT_ID:0:2}/$MOMENT_ID \
--output=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID
fi
gems-rec-convert \
--exec_path=/root/cybertron \
--input_path=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/rec \
--output_path=/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/pb
mkdir -p /data/$TEST_CASE_NAME/regenerated/pb
cp -a /root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID/pb /data/$TEST_CASE_NAME/regenerated
if [[ $SIM_MODE == "IDEAL" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/${MOMENT_ID:0:2}/$MOMENT_ID/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID"
elif [[ $SIM_MODE == "WORLD" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID"
elif [[ $SIM_MODE == "TIMELY" ]]; then
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/${MOMENT_ID:0:2}/$MOMENT_ID/$LAUNCH_NAME/$CYBERTRON_COMMIT_ID"
fi
# calculate disk storage
du -hd 1 /root
ls -l /root/cybertron || true
du -hd 1 /root/cybertron
ossutil cp --config-file=/root/.ossutilconfig -r -f \
/root/moments-regenerated/${MOMENT_ID:0:2}/$MOMENT_ID \
$OSS_DEST_PATH
volumeMounts:
- mountPath: /root/.jfrog/jfrog-cli.conf
name: credentials-volume
subPath: jfrog-cli.conf
- mountPath: /root/.ossutilconfig
name: credentials-volume
subPath: .ossutilconfig
- mountPath: /data
name: artifacts-volume-claim
synchronization:
semaphore:
configMapKeyRef:
key: trucksim_regenarate_template
name: gems-sync
tolerations:
- effect: NoSchedule
key: gpu_node
operator: Equal
value: "true"
- arguments: {}
inputs:
parameters:
- name: test_case_name
metadata: {}
name: evaluate
outputs: {}
retryStrategy:
limit: 2
retryPolicy: OnError
script:
command:
- bash
env:
- name: REGRESSION_COMMIT_ID
value: '{{workflow.parameters.regression_commit_id}}'
- name: TEST_CASE_NAME
value: '{{inputs.parameters.test_case_name}}'
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: REGENERATED_BUCKET
valueFrom:
configMapKeyRef:
key: moment_regenerated_oss_bucket
name: cluster-configs
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/infra_regenerate-gems:v20210105-5044b06
name: ""
resources: {}
source: |
set -ex
# download ground truth path
GROUND_TRUTH_OSS_PATH=oss://inceptio-test-case-management-dev/$TEST_CASE_NAME/groud_truth/*
mkdir -p /data/$TEST_CASE_NAME/evaluate/ground_truth
SIZE=$(ossutil ls --config-file=/root/.ossutilconfig -s \
$GROUND_TRUTH_OSS_PATH \
| tail -n 3 | head -n 1 | awk '{print$4}')
if [[ $SIZE -ne 0 && $SIZE -ne 1 ]]; then
GROUND_TRUTH_LOCAL=/data/$TEST_CASE_NAME/evaluate/ground_truth
ossutil cp --config-file=/root/.ossutilconfig -r -f \
$GROUND_TRUTH_OSS_PATH \
$GROUND_TRUTH_LOCAL
fi
cat_gems_task_pbtxt(){ cat /data/regression/$TEST_CASE_NAME/gems_task_v2.pb.txt; }
trim_prefix_suffix_quote(){ sed -e 's/^"//' -e 's/"$//'; }
MOMENT_ID=$(cat_gems_task_pbtxt | grep moment_id | awk '{print$2}' | trim_prefix_suffix_quote)
MAP=$(cat_gems_task_pbtxt | grep map_version | awk '{print$2}' | trim_prefix_suffix_quote)
TOPICS=$(cat_gems_task_pbtxt | grep evaluation_topics | awk '{print$2}' | trim_prefix_suffix_quote )
SIM_MODE=$(cat_gems_task_pbtxt | grep "sim_mode:" | awk '{print$2}')
EVALUATE_FILE_NAME=$(echo ${TEST_CASE_NAME} | sed 's/\//_/g')
ls /data/
if [[ $SIM_MODE == "IDEAL" ]]; then
EVALUATE_OUTPUT_PATH=/data/evaluate_result/${MOMENT_ID}.json
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/evaluate_result/${MOMENT_ID:0:2}/$MOMENT_ID/$SIM_MODE/$TEST_CASE_NAME/$CYBERTRON_COMMIT_ID/${MOMENT_ID}.json"
elif [[ $SIM_MODE == "WORLD" ]]; then
EVALUATE_OUTPUT_PATH=/data/evaluate_result/${EVALUATE_FILE_NAME}.json
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/evaluate_result/$SIM_MODE/$TEST_CASE_NAME/${TEST_CASE_NAME}.json"
elif [[ $SIM_MODE == "TIMELY" ]]; then
EVALUATE_OUTPUT_PATH=/data/evaluate_result/${MOMENT_ID}.json
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/evaluate_result/${MOMENT_ID:0:2}/$MOMENT_ID/$LAUNCH_NAME/$CYBERTRON_COMMIT_ID/${MOMENT_ID}.json"
fi
mkdir -p ${EVALUATE_OUTPUT_PATH%/*}
cd /data/regression/$TEST_CASE_NAME
evaluate \
--lep=local_transformation \
--srp=/data/$TEST_CASE_NAME/regenerated/pb \
--topics $TOPICS \
--output=$EVALUATE_OUTPUT_PATH \
--map=$MAP \
--moment=$MOMENT_ID \
--test-name=$TEST_CASE_NAME \
--gtp "$GROUND_TRUTH_LOCAL" | tee evaluate.log
if cat evaluate.log | grep "Evaluation Result:" -A 1 | grep "FAIL"; then
EXIT_CODE=1
else
EXIT_CODE=0
fi
ossutil cp --config-file=/root/.ossutilconfig -r -f \
$EVALUATE_OUTPUT_PATH \
$OSS_DEST_PATH
exit $EXIT_CODE
volumeMounts:
- mountPath: /data
name: artifacts-volume-claim
- mountPath: /root/.ossutilconfig
name: credentials-volume
subPath: .ossutilconfig
- arguments: {}
inputs: {}
metadata: {}
name: aggregation
outputs: {}
script:
command:
- bash
env:
- name: REGRESSION_COMMIT_ID
value: '{{workflow.parameters.regression_commit_id}}'
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: REGENERATED_BUCKET
valueFrom:
configMapKeyRef:
key: moment_regenerated_oss_bucket
name: cluster-configs
- name: GITLAB_TOKEN
valueFrom:
secretKeyRef:
key: gitlab-read-repository-token
name: argo-hubble-secrets
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/infra_regenerate-gems:v20210105-5044b06
name: ""
resources: {}
source: |
set -x
AGGREGATION_PATH=/data/aggregation_result
mkdir -p $AGGREGATION_PATH
ls -l $AGGREGATION_PATH
ls -lR /data/evaluate_result
aggregate \
--input=/data/evaluate_result \
--output=$AGGREGATION_PATH/aggregation_result.json
RES=$?
ls -l $AGGREGATION_PATH/aggregation_result.json
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/aggregation_result/$CYBERTRON_COMMIT_ID/$REGRESSION_COMMIT_ID"
ossutil cp --config-file=/root/.ossutilconfig -r -f \
$AGGREGATION_PATH \
$OSS_DEST_PATH
exit $RES
volumeMounts:
- mountPath: /data
name: artifacts-volume-claim
- mountPath: /root/.ossutilconfig
name: credentials-volume
subPath: .ossutilconfig
- arguments: {}
inputs:
parameters:
- name: cybertron_commit_timestamp
value: '{{workflow.outputs.parameters.global_cybertron_commit_timestamp}}'
- name: cybertron_commit_author
value: '{{workflow.outputs.parameters.global_cybertron_commit_author}}'
metadata: {}
name: ingest
outputs: {}
script:
command:
- bash
env:
- name: CYBERTRON_COMMIT_ID
value: '{{workflow.parameters.cybertron_commit_id}}'
- name: CYBERTRON_BRANCH
value: '{{workflow.parameters.cybertron_branch}}'
- name: CYBERTRON_COMMIT_TIMESTAMP
value: '{{inputs.parameters.cybertron_commit_timestamp}}'
- name: CYBERTRON_COMMIT_AUTHOR
value: '{{inputs.parameters.cybertron_commit_author}}'
- name: WORKFLOW
value: '{{workflow.name}}'
- name: REGRESSION_COMMIT_ID
value: '{{workflow.parameters.regression_commit_id}}'
- name: REGENERATED_BUCKET
valueFrom:
configMapKeyRef:
key: moment_regenerated_oss_bucket
name: cluster-configs
image: registry-vpc.cn-hangzhou.aliyuncs.com/inceptio/infra_metrics:v20201218-ac92e3a
name: ""
resources: {}
source: |
set -x
CYBERTRON_COMMIT_TIMESTAMP=$(echo $CYBERTRON_COMMIT_TIMESTAMP | sed -e 's/^"//' -e 's/"$//')
OSS_DEST_PATH="oss://$REGENERATED_BUCKET/aggregation_result/$CYBERTRON_COMMIT_ID/$REGRESSION_COMMIT_ID"
metrics ingest gems \
--cybertron-commit-id=$CYBERTRON_COMMIT_ID \
--cybertron-branch=$CYBERTRON_BRANCH \
--cybertron-commit-timestamp=$CYBERTRON_COMMIT_TIMESTAMP \
--cybertron-commit-author=$CYBERTRON_COMMIT_AUTHOR \
--workflow=$WORKFLOW \
--file-url=$OSS_DEST_PATH/aggregation_result.json \
--merge
volumeMounts:
- mountPath: /etc/metrics/mysql-config.yaml
name: metrics-volume
subPath: mysql.yaml
- mountPath: /etc/metrics/oss-config.yaml
name: credentials-volume
subPath: config.yaml
- mountPath: /data
name: artifacts-volume-claim
ttlStrategy:
secondsAfterFailure: 43200
secondsAfterSuccess: 3600
volumeClaimTemplates:
- metadata:
creationTimestamp: null
name: artifacts-volume-claim
spec:
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 10Gi
storageClassName: alicloud-flexvolume-nas-sc
status: {}
volumes:
- name: credentials-volume
secret:
secretName: argo-hubble-secrets
- name: gitlab-ssh-key-volume
secret:
defaultMode: 384
secretName: gitlab-ssh-key-secrets
- name: metrics-volume
secret:
secretName: fusion-metrics-secrets
- emptyDir: {}
name: tmpdir
status:
artifactRepositoryRef:
default: true
finishedAt: null
nodes:
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7:
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4031031283
displayName: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
finishedAt: null
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
phase: Running
progress: 23/23
startedAt: "2021-01-13T12:14:45Z"
templateName: gems-entrypoint
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-68571808:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3741392784
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-68571808
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-127158400:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3741392784
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:05Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-127158400
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_south_1141
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 1
memory: 1
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-213961484:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3024624406
displayName: fetch-regression-repository-step(0)
finishedAt: "2021-01-13T12:16:19Z"
hostNodeName: cn-hangzhou.10.128.98.235
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-213961484
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0].fetch-regression-repository-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 176
memory: 176
startedAt: "2021-01-13T12:14:45Z"
templateName: fetch-regression-repository
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-269414011:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3228849915
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-269414011
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 188
memory: 188
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-275563684:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4035425836
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:01Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-275563684
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1221
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 1
memory: 1
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-291664601:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-127158400
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-291664601
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_south_1141
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 206
memory: 206
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-324195964:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4095064236
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-324195964
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-406695329:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4035425836
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-406695329
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-477025405:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3024624406
displayName: build-cybertron-pkg-step(0)
finishedAt: "2021-01-13T12:15:58Z"
hostNodeName: cn-hangzhou.10.128.98.235
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-477025405
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0].build-cybertron-pkg-step(0)
outputs:
exitCode: "0"
parameters:
- globalName: global_cybertron_commit_timestamp
name: cybertron_commit_timestamp
value: '"1610430777"'
valueFrom:
path: /tmpdir/cybertron_commit_timestamp.txt
- globalName: global_cybertron_commit_author
name: cybertron_commit_author
value: xiaofan.mu@inceptio.ai
valueFrom:
path: /tmpdir/cybertron_commit_author.txt
- globalName: global_idl_version
name: idl_version
value: ..
valueFrom:
path: /tmpdir/idl_version.txt
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 135
memory: 135
startedAt: "2021-01-13T12:14:45Z"
templateName: build-cybertron-pkg
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-558330273:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2336194607
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-558330273
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-592867953:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:02Z"
hostNodeName: cn-hangzhou.10.128.98.235
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-592867953
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_2121
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-610566068:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4035425836
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-610566068
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4102389217
displayName: regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1221
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3385189450'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2972558065
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 206
memory: 206
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-729756668:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4035425836
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-729756668
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-789122789:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3741392784
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-789122789
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-801673974:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2926645237
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-801673974
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1121
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 191
memory: 191
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-829637410:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3551042008
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-829637410
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(9:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1111,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1363669702
displayName: regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_south_1131
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3050946813'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1433739404
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-964527601:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3551042008
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-964527601
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(9:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1111,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1019922320:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:17Z"
hostNodeName: cn-hangzhou.10.128.109.137
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1019922320
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1211
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:17:12Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1071215084:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3024624406
displayName: build-cybertron-sim-p1-step(0)
finishedAt: "2021-01-13T12:14:50Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1071215084
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0].build-cybertron-sim-p1-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 1
memory: 1
startedAt: "2021-01-13T12:14:45Z"
templateName: build-cybertron-sim-p1
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1192303368:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1871873947
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1192303368
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_2111
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 189
memory: 189
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1211491917:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:17Z"
hostNodeName: cn-hangzhou.10.128.109.137
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1211491917
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_south_1141
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1244575150:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3079194717
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1244575150
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1321
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1250457496:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-801673974
displayName: '[1]'
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1250457496
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-801673974'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 191
memory: 191
startedAt: "2021-01-13T12:17:11Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1296412131:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3050946813
displayName: '[1]'
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1296412131
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3050946813'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:17:11Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1299412752:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3529020979
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1299412752
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_south_1131
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1317420877:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3328738768
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3490648065
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3249870445
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2314528024
displayName: '[0]'
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1317420877
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 192
memory: 192
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1337420162:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4098539117
displayName: fetch-test-group-step
finishedAt: "2021-01-13T12:16:33Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1337420162
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[1].fetch-test-group-step
outputs:
exitCode: "0"
result: |-
[
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_south_1141",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_north_2121",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_north_1321",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_north_1221",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_north_1121",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_60_south_1131",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_60_north_2111",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_60_north_1311",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_60_north_1211",
"truck_sim": "true"
},
{
"gpu_requirement": "0",
"test_case_name": "control_tests/jinan_lka_60_north_1111",
"truck_sim": "true"
}
]
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 3
memory: 3
startedAt: "2021-01-13T12:16:29Z"
templateName: fetch-test-group
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1344779168:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1244575150
displayName: '[1]'
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1344779168
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1244575150'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:17:11Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1363669702:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1734346451
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1299412752
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2530900054
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3611099437
displayName: '[0]'
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1363669702
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1411742549:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2652746280
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3405612553
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1965213429
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3764123472
displayName: '[0]'
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1411742549
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1433739404:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:06Z"
hostNodeName: cn-hangzhou.10.128.98.232
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1433739404
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_south_1131
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4162027617
displayName: regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_2121
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1729045194'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-592867953
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2734588549
displayName: regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_south_1141
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2557456158'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1211491917
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 206
memory: 206
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1694949156:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4095064236
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:05Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1694949156
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_2121
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 0
memory: 0
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1707048177:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3011694024
displayName: build-cybertron-sim-step
finishedAt: "2021-01-13T12:15:05Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1707048177
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0].build-cybertron-sim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 20/20
resourcesDuration:
cpu: 1766
memory: 1766
startedAt: "2021-01-13T12:14:45Z"
templateName: build-cybertron-sim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1729045194:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-592867953
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1729045194
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_2121
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1734346451:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1296412131
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1734346451
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1743165858:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3494780215
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3699291180
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2218314754
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4073946193
displayName: '[0]'
finishedAt: "2021-01-13T12:17:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1743165858
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 204
memory: 204
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1871873947:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3228849915
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:06Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1871873947
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_2111
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 1
memory: 1
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1945587890:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2336194607
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1945587890
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1965213429:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1344779168
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1965213429
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1965535357:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-213961484
displayName: fetch-regression-repository-step
finishedAt: "2021-01-13T12:16:29Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1965535357
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0].fetch-regression-repository-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 20/20
resourcesDuration:
cpu: 1938
memory: 1938
startedAt: "2021-01-13T12:14:45Z"
templateName: fetch-regression-repository
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1985714517:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3228849915
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1985714517
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 188
memory: 188
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1411742549
displayName: regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1321
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1244575150'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3079194717
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2152265761:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4095064236
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2152265761
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2183692492:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3551042008
displayName: regenerate-trucksim-step
finishedAt: null
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2183692492
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1111
message: 'Waiting for argo-hubble/ConfigMap/gems-sync/trucksim_regenarate_template
lock. Lock status: 0/9 '
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(9:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1111,truck_sim:true)[0].regenerate-trucksim-step
phase: Pending
startedAt: "2021-01-13T12:16:39Z"
synchronizationStatus:
waiting: argo-hubble/ConfigMap/gems-sync/trucksim_regenarate_template
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2218314754:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2749675903
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2218314754
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1317420877
displayName: regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1121
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-801673974'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2926645237
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 192
memory: 192
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2290121541:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1694949156
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2290121541
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_2121
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2314528024:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1250457496
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2314528024
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 191
memory: 191
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2336194607:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3287310681
displayName: '[1]'
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2336194607
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3287310681'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:17:12Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2361211845:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-275563684
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2361211845
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1221
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 206
memory: 206
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2403452178:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2633094439
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3048519676
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1945587890
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-558330273
displayName: '[0]'
finishedAt: "2021-01-13T12:17:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2403452178
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 204
memory: 204
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2530900054:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1296412131
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2530900054
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2557456158:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1211491917
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2557456158
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_south_1141
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2633094439:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2336194607
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2633094439
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2652746280:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1344779168
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2652746280
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2669395086:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3228849915
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2669395086
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 188
memory: 188
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2701053655:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3551042008
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2701053655
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(9:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1111,truck_sim:true)[0].regenerate-step
phase: Skipped
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2734588549:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4060091032
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-291664601
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-789122789
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-68571808
displayName: '[0]'
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2734588549
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 206
memory: 206
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2749675903:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3906825385
displayName: '[1]'
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2749675903
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3906825385'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:17:12Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3296107486
displayName: regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_2111
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3955556197'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3706776644
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 189
memory: 189
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2926645237:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:06Z"
hostNodeName: cn-hangzhou.10.128.98.232
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2926645237
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1121
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 191
memory: 191
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2972558065:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:17Z"
hostNodeName: cn-hangzhou.10.128.109.137
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2972558065
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1221
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3011694024:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3024624406
displayName: build-cybertron-sim-step(0)
finishedAt: "2021-01-13T12:14:54Z"
hostNodeName: cn-hangzhou.10.128.98.235
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3011694024
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0].build-cybertron-sim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 4
memory: 4
startedAt: "2021-01-13T12:14:45Z"
templateName: build-cybertron-sim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3024624406:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1337420162
displayName: '[1]'
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3024624406
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[1]
phase: Succeeded
progress: 19/19
resourcesDuration:
cpu: 1762
memory: 1762
startedAt: "2021-01-13T12:16:29Z"
templateName: gems-entrypoint
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3048519676:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3782999863
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3048519676
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1311
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 204
memory: 204
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3050946813:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1433739404
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3050946813
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_south_1131
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3052868802:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3551042008
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2701053655
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2183692492
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-829637410
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-964527601
displayName: '[0]'
finishedAt: null
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3052868802
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(9:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1111,truck_sim:true)[0]
phase: Running
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3079194717:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:02Z"
hostNodeName: cn-hangzhou.10.128.98.235
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3079194717
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1321
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3228849915:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3955556197
displayName: '[1]'
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3228849915
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3955556197'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 188
memory: 188
startedAt: "2021-01-13T12:17:11Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3249870445:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1250457496
displayName: regenerate-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3249870445
message: when '0 != 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[0].regenerate-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 191
memory: 191
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3287310681:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3689719808
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3287310681
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1311
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:17:12Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3296107486:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-269414011
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1192303368
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2669395086
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1985714517
displayName: '[0]'
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3296107486
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 189
memory: 189
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3328738768:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1250457496
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3328738768
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 191
memory: 191
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1743165858
displayName: regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1211
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3906825385'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1019922320
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 204
memory: 204
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3339094222:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-477025405
displayName: build-cybertron-pkg-step
finishedAt: "2021-01-13T12:16:08Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3339094222
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0].build-cybertron-pkg-step
outputs:
exitCode: "0"
parameters:
- globalName: global_cybertron_commit_timestamp
name: cybertron_commit_timestamp
value: '"1610430777"'
valueFrom:
path: /tmpdir/cybertron_commit_timestamp.txt
- globalName: global_cybertron_commit_author
name: cybertron_commit_author
value: xiaofan.mu@inceptio.ai
valueFrom:
path: /tmpdir/cybertron_commit_author.txt
- globalName: global_idl_version
name: idl_version
value: ..
valueFrom:
path: /tmpdir/idl_version.txt
phase: Succeeded
progress: 20/20
resourcesDuration:
cpu: 1897
memory: 1897
startedAt: "2021-01-13T12:14:45Z"
templateName: build-cybertron-pkg
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3385189450:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2972558065
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3385189450
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1221
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3405612553:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4080937584
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3405612553
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1321
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3490648065:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4144182104
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3490648065
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1121
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 192
memory: 192
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3494780215:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2749675903
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3494780215
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3529020979:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1296412131
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:05Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3529020979
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_south_1131
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 0
memory: 0
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3539744564:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4095064236
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3539744564
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3551042008:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3052868802
displayName: regression-step(9:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1111,truck_sim:true)
finishedAt: null
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3551042008
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1111
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(9:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1111,truck_sim:true)
phase: Running
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2403452178
displayName: regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1311
- name: gpu_requirement
value: "0"
- name: truck_sim
value: "true"
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3287310681'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)
outboundNodes:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3689719808
phase: Failed
progress: 2/2
resourcesDuration:
cpu: 204
memory: 204
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Steps
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3611099437:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1296412131
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3611099437
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(5:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_south_1131,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 190
memory: 190
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3689719808:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:17Z"
hostNodeName: cn-hangzhou.10.128.109.137
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3689719808
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1311
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:17:12Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3699291180:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3993786535
displayName: regenerate-trucksim-step
finishedAt: "2021-01-13T12:17:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3699291180
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1211
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[0].regenerate-trucksim-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 204
memory: 204
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3706776644:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
displayName: evaluate-step(0)
finishedAt: "2021-01-13T12:20:04Z"
hostNodeName: cn-hangzhou.10.128.98.232
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3706776644
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_2111
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[1].evaluate-step(0)
outputs:
exitCode: "1"
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 188
memory: 188
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3741392784:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2557456158
displayName: '[1]'
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3741392784
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2557456158'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:17:11Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3764123472:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1344779168
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3764123472
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3782999863:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2336194607
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:02Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3782999863
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1311
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(7:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1311,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 1
memory: 1
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3796773213:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1071215084
displayName: build-cybertron-sim-p1-step
finishedAt: "2021-01-13T12:14:55Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3796773213
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0].build-cybertron-sim-p1-step
outputs:
exitCode: "0"
phase: Succeeded
progress: 20/20
resourcesDuration:
cpu: 1763
memory: 1763
startedAt: "2021-01-13T12:14:45Z"
templateName: build-cybertron-sim-p1
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3906825385:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1019922320
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3906825385
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1211
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:17:12Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3955556197:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3706776644
displayName: evaluate-step
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3955556197
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_2111
message: failed with exit code 1
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(6:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_2111,truck_sim:true)[1].evaluate-step
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 188
memory: 188
startedAt: "2021-01-13T12:17:11Z"
templateName: evaluate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Retry
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3993786535:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2749675903
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:04Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3993786535
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_60_north_1211
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 1
memory: 1
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4031031283:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3339094222
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1707048177
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3796773213
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1965535357
displayName: '[0]'
finishedAt: "2021-01-13T12:16:29Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4031031283
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[0]
phase: Succeeded
progress: 23/23
resourcesDuration:
cpu: 2078
memory: 2078
startedAt: "2021-01-13T12:14:45Z"
templateName: gems-entrypoint
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4035425836:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3385189450
displayName: '[1]'
finishedAt: "2021-01-13T12:20:22Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4035425836
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3385189450'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:17:11Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4060091032:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3741392784
displayName: regenerate-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4060091032
message: when '0 == 0 && true != true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(0:gpu_requirement:0,test_case_name:control_tests/jinan_lka_south_1141,truck_sim:true)[0].regenerate-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 205
memory: 205
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4073946193:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2749675903
displayName: regenerate-trucksim-gpu-step
finishedAt: "2021-01-13T12:16:39Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4073946193
message: when '0 != 0 && true == true' evaluated false
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(8:gpu_requirement:0,test_case_name:control_tests/jinan_lka_60_north_1211,truck_sim:true)[0].regenerate-trucksim-gpu-step
phase: Skipped
progress: 1/1
resourcesDuration:
cpu: 203
memory: 203
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim-gpu
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Skipped
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4080937584:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1344779168
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:04Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4080937584
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1321
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(2:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1321,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 0
memory: 0
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4095064236:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1729045194
displayName: '[1]'
finishedAt: "2021-01-13T12:20:12Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4095064236
message: child 'gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1729045194'
failed
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[1]
phase: Failed
progress: 1/1
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:17:11Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4098539117:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1687177185
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2150878129
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-845459564
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2832051700
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3602065704
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3331391928
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3551042008
displayName: '[2]'
finishedAt: null
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4098539117
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2]
phase: Running
progress: 18/18
startedAt: "2021-01-13T12:16:39Z"
templateName: gems-entrypoint
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4102389217:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-722146525
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-729756668
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2361211845
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-406695329
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-610566068
displayName: '[0]'
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4102389217
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(3:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1221,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 206
memory: 206
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4144182104:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2282790969
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1250457496
displayName: regenerate-trucksim-step(0)
finishedAt: "2021-01-13T12:17:02Z"
hostNodeName: virtual-kubelet
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4144182104
inputs:
parameters:
- name: test_case_name
value: control_tests/jinan_lka_north_1121
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(4:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_1121,truck_sim:true)[0].regenerate-trucksim-step(0)
outputs:
exitCode: "0"
phase: Succeeded
progress: 1/1
resourcesDuration:
cpu: 1
memory: 1
startedAt: "2021-01-13T12:16:39Z"
templateName: regenerate-trucksim
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: Pod
gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4162027617:
boundaryID: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1565592669
children:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-324195964
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2290121541
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2152265761
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3539744564
displayName: '[0]'
finishedAt: "2021-01-13T12:17:11Z"
id: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-4162027617
name: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7[2].regression-step(1:gpu_requirement:0,test_case_name:control_tests/jinan_lka_north_2121,truck_sim:true)[0]
phase: Succeeded
progress: 2/2
resourcesDuration:
cpu: 184
memory: 184
startedAt: "2021-01-13T12:16:39Z"
templateName: regression
templateScope: local/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
type: StepGroup
outputs:
parameters:
- name: global_cybertron_commit_timestamp
value: '"1610430777"'
- name: global_cybertron_commit_author
value: xiaofan.mu@inceptio.ai
- name: global_idl_version
value: ..
persistentVolumeClaims:
- name: artifacts-volume-claim
persistentVolumeClaim:
claimName: gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-artifacts-volume-claim
phase: Running
progress: 23/23
resourcesDuration:
cpu: 2078
memory: 2078
startedAt: "2021-01-13T12:14:45Z"
synchronization:
semaphore:
holding:
- holders:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7
semaphore: argo-hubble/ConfigMap/gems-sync/gems_wf_limited
- holders:
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-291664601
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2290121541
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3405612553
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2361211845
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3490648065
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1299412752
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1192303368
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3048519676
- gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3699291180
semaphore: argo-hubble/ConfigMap/gems-sync/trucksim_regenarate_template
waiting:
- holders:
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2290121541
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-2361211845
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3699291180
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-291664601
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3405612553
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3490648065
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1299412752
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-1192303368
- argo-hubble/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7/gems-wf-v0-8-60d146aa-e5ad-4b62-b7cb-a319ce581ee7-3048519676
semaphore: argo-hubble/ConfigMap/gems-sync/trucksim_regenarate_template
The controller log https://gist.github.com/juchaosong/e606ea193078d56aeeb9df71566983f1. @sarabala1979 The bug is same.
@juchaosong I was working with another Semaphore issue #4832. I found a few edge case lock is not being released. I fixed and build a eng build.
Is it possible to try on your env to verify whether issue is fixed or not?
sarabala1979/workflow-controller:mutex
@sarabala1979 I saw the issue https://github.com/argoproj/argo/issues/4832, and I've tried the sarabala1979/workflow-controller:mutex
image, but it' seems not working.
@juchaosong I pushed the new image few minutes before. Can you pull the new image and try it?
@sarabala1979 Okay, I'm try it.
@sarabala1979 The latest sarabala1979/workflow-controller:mutex
image is working, the semaphore has been released after pod is finished.
Thx a lot.
Summary
What happened/what you expected to happen? semaphore can be released when step is finished
Diagnostics
What Kubernetes provider are you using? ACK
What version of Argo Workflows are you running? v2.12.4
Message from the maintainers:
Impacted by this bug? Give it a 👍. We prioritise the issues with the most 👍.