intel-analytics / analytics-zoo

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray
https://analytics-zoo.readthedocs.io/
Apache License 2.0
11 stars 3 forks source link

[BIGDL-2.0] migrate orca examples #76

Open yangw1234 opened 2 years ago

yangw1234 commented 2 years ago

Reference Steps: intel-analytics/analytics-zoo-internal#88

File Mapping: pyzoo/zoo/examples/orca/data -> python/orca/example/data python/zoo/example/orca/learn -> python/orca/example/learn pyzoo/zoo/examples/ray_on_spark -> python/orca/example/ray_on_spark pyzoo/zoo/examples/pytorch -> python/orca/example/torchmodel pyzoo/zoo/examples/tensorflow/tfpark -> python/orca/example/tfpark pyzoo/zoo/examples/run-example-test-ray-horovod-pytorch-integration.sh -> python/orca/dev/example/run-example-test-ray-horovod-pytorch-integration.sh pyzoo/zoo/examples/run-example-test-ray-horovod-pytorch.sh -> python/orca/dev/example/run-example-test-ray-horovod-pytorch.sh (except chronos) pyzoo/zoo/examples/run-example-test-ray-horovod-tf.sh -> python/orca/dev/example/run-example-test-ray-horovod-tf.sh pyzoo/zoo/examples/run-example-test-ray.sh -> python/orca/dev/example/run-example-test-ray.sh (except chronos and automl) pyzoo/zoo/examples/run-example-tests-jep.sh -> python/orca/dev/example/run-example-tests-jep.sh pyzoo/zoo/examples/run-example-tests.sh -> python/orca/dev/example/run-example-tests.sh (only tfpark and orca)

Jenkins jobs: http://10.112.231.51:18888/job/ZOO-PR-Python-ExampleTests-py37-ray-horovod-Spark3/ (run-example-test-ray-horovod-pytorch.sh, run-example-test-ray-horovod-tf.sh) http://10.112.231.51:18888/job/ZOO-PR-Python-ExampleTests-py37-ray-Spark3/ (run-example-test-ray.sh) http://10.112.231.51:18888/job/ZOO-PR-Python-ExampleTests-py37-Spark3/ (run-example-tests.sh) http://10.112.231.51:18888/job/ZOO-PR-Pip-JEP-UT-Spark2.4/ (run-example-tests-jep.sh) http://10.112.231.51:18888/view/ZOO-PR/job/ZOO-PR-Python-integration-test-horovod/ (run-example-test-ray-horovod-pytorch-integration.sh)