SUBMARINE-1401. Refactor docker image workflow to avoid no space issues

[cdmikechen]

What is this PR for?

The docker image push fails at the last few stages due to no space, and the build process needs to be split up a bit to avoid this problem.

Link: https://github.com/apache/submarine/actions/runs/5760002365/job/15615121566

What type of PR is it?

Refactor

Todos

• [x] - deploy_docker_images.yml

What is the Jira issue?

https://issues.apache.org/jira/browse/SUBMARINE-1401

How should this be tested?

We can view this action: https://github.com/cdmikechen/submarine/actions/runs/5809697567

Screenshots (if appropriate)

Questions:

• Do the license files need updating? YNo
• Are there breaking changes for older versions? No
• Does this need new documentation? No

[codecov[bot]]

Codecov Report

Merging #1095 (a571b85) into master (f170037) will not change coverage. The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1095   +/-   ##
=======================================
  Coverage   67.27%   67.27%           
=======================================
  Files         128      128           
  Lines        6224     6224           
=======================================
  Hits         4187     4187           
  Misses       2037     2037           

Flag	Coverage Δ
python-integration	54.20% <ø> (+0.58%)	:arrow_up:
python-unit	48.00% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more