search

ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
32.94k stars 5.58k forks source link

[raysgd] How to set spot workers for an Azure cluster? #8394

Closed AndreCNF closed 4 years ago

AndreCNF commented 4 years ago

In Azure, we should be able to set a node as spot (preemptible) by setting properties.priority = 'Spot'. However, I can't understand how to translate this into my cluster configuration YAML, as there is no information on GitHub or the documentation that I'm aware of which indicates the spot parameter for Azure clusters.

For reference, in the automatic cluster setup documentation, while the Azure example mentions a setting of an on-demand head node and spot worker nodes, that's not what actually happens, as I get all the workers as on-demand in Azure. In fact, I wouldn't expect otherwise as, contrary to the GCP and AWS examples, there is no difference in the parameters between head_node and worker_nodes.

Is there any way to set spot workers in an Azure cluster? Or is this feature not yet implemented?

richardliaw commented 4 years ago

@AndreCNF can you try using https://github.com/ray-project/ray/blob/37e4d29f8715330eb772f05513c696fd852ab565/python/ray/autoscaler/azure/example-full.yaml

@gramhagen @eisber seems like this config was removed from the examples. Can you take a look? It'll be important for users to know how to enable spot instances.

gramhagen commented 4 years ago

yes, good catch. It is possible to add this by modifying the VM ARM template used to deploy workers here: https://github.com/ray-project/ray/blob/8d0c1b5e068853bf748f72b1e60ec99d240932c6/python/ray/autoscaler/azure/azure-vm-template.json#L175

To change workers to spot instance you can modify it as shown here: https://docs.microsoft.com/en-us/azure/virtual-machines/linux/spot-template like this:

            "properties": {
                "priority": "Spot",
                "evictionPolicy": "Deallocate",
                "billingProfile": {
                    "maxPrice": -1
                },
                "hardwareProfile": {
                    "vmSize": "[parameters('vmSize')]"
                },
                ...

@richardliaw @eisber I'm thinking it might be more general to incorporate the change needed by the user into the config yaml file. Maybe the simplest would be something like below. Thoughts?

https://github.com/ray-project/ray/blob/8d0c1b5e068853bf748f72b1e60ec99d240932c6/python/ray/autoscaler/azure/example-full.yaml#L79

worker_nodes:
    azure_arm_parameters:
        vmSize: Standard_D2s_v3
        # List images https://docs.microsoft.com/en-us/azure/virtual-machines/linux/cli-ps-findimage
        imagePublisher: microsoft-dsvm
        imageOffer: ubuntu-1804
        imageSku: 1804-gen2
        imageVersion: 20.02.01
        priority: Spot
        maxPrice: -1
richardliaw commented 4 years ago

Yeah that sounds good. Can you push a fix to the examples?

eisber commented 4 years ago

if that is a common ask, than I think it's a good idea to make it accessible through the yaml config.

Maybe we should document how to copy and modify the templates to get full control over all aspects.

richardliaw commented 4 years ago

@eisber Yeah, agree - spot instances are going to be important for many users.

AndreCNF commented 4 years ago

@gramhagen I've been trying to implement your suggestion, of modifying the VM ARM template. However, it seems like only one of my worker nodes is set as a spot instance this way. I'm guessing all nodes, beyond the head node, need to have the same Ray version, with this same Azure configuration. Now I'm not being able to create a custom Ray wheel, built from my forked version of Ray, despite following the instructions from README-building-wheels.md. When doing so, I get these errors:

echo 'TRAVIS_COMMIT variable not set - required to populated ray.__commit__.'
TRAVIS_COMMIT variable not set - required to populated ray.__commit__.
exit 1

Have you guys already worked on a fix to the azure_arm_parameters to include these spot workers settings? Or can you help me with explaining how to create an installable file from my forked Ray version?

gramhagen commented 4 years ago

Hi @AndreCNF, sorry I haven't had any time to work on this yet. Yes you're correct, I forgot the template is pulled from wheel used by the head node to create the worker nodes.

Building the wheel for distribution is a bit of a pain. My process is like this: 1) Copy build-wheel-manylinux1.sh to build-my-wheel.sh and modify as follows a) Remove all but 1 python version here b) Change this line to mkdir -p .whl so it doesn't complain if I've previously created that folder c) Comment out the exit line for the travis check. 2) Run the docker build command: docker run --rm -w /ray -vpwd:/ray -ti rayproject/arrow_linux_x86_64_base:latest /ray/python/build-my-wheel.sh 3) Upload your wheel to blob store 4) Update your yaml file to point to the new wheel 5) Ray up cluster.yaml

AndreCNF commented 4 years ago

Thank you @gramhagen for the step-by-step explanation of your process! However, I'm still having problems when building the wheel (i.e. step 2). I'm using this build-my-wheel.sh script, with the changes that you suggested in step 1. Can you have a look please?

Here's what I get in the terminal:

docker run --rm -w /ray -v `pwd`:/ray -ti rayproject/arrow_linux_x86_64_base:latest /ray/python/build-my-wheel.sh
+ set -e
+ cat
+ chmod +x /usr/bin/nproc
+ PYTHONS=("cp37-cp37m")
+ NUMPY_VERSIONS=("1.14.5" "1.14.5" "1.14.5" "1.14.5")
+ sudo apt-get install unzip
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Suggested packages:
  zip
The following NEW packages will be installed:
  unzip
0 upgraded, 1 newly installed, 0 to remove and 5 not upgraded.
Need to get 157 kB of archives.
After this operation, 395 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu/ trusty-updates/main unzip amd64 6.0-9ubuntu1.5 [157 kB]
Fetched 157 kB in 0s (478 kB/s)
Selecting previously unselected package unzip.
(Reading database ... 18847 files and directories currently installed.)
Preparing to unpack .../unzip_6.0-9ubuntu1.5_amd64.deb ...
Unpacking unzip (6.0-9ubuntu1.5) ...
Processing triggers for mime-support (3.54ubuntu1.1) ...
Setting up unzip (6.0-9ubuntu1.5) ...
+ /ray/ci/travis/install-bazel.sh
Platform is Linux (or WSL).
+ export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/bin
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/bin
+ set +x
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0        0 13226    0     0    0     0      0      100 13226  100 13226    0     0  14799      0 --:--:-- --:--:-- --:--:-- 14794
=> Downloading nvm from git to '/root/.nvm'
=> Cloning into '/root/.nvm'...
remote: Enumerating objects: 278, done.
remote: Counting objects: 100% (278/278), done.
remote: Compressing objects: 100% (245/245), done.
remote: Total 278 (delta 32), reused 95 (delta 20), pack-reused 0
Receiving objects: 100% (278/278), 142.15 KiB | 0 bytes/s, done.
Resolving deltas: 100% (32/32), done.
Checking connectivity... done.
=> Compressing and cleaning up git repository

=> Appending nvm source string to /root/.bashrc
=> Appending bash_completion source string to /root/.bashrc
=> Close and reopen your terminal to start using nvm or run the following to use it now:

export NVM_DIR="$HOME/.nvm"
[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh"  # This loads nvm
[ -s "$NVM_DIR/bash_completion" ] && \. "$NVM_DIR/bash_completion"  # This loads nvm bash_completion
Downloading and installing node v14.4.0...
Downloading https://nodejs.org/dist/v14.4.0/node-v14.4.0-linux-x64.tar.xz...
##                                          ########                                    ##############                              ####################                        ###########################                 ###################################         ########################################### ############################################################################################################################################################################################################ 100.0%
Computing checksum with sha256sum
Checksums matched!
Now using node v14.4.0 (npm v6.14.5)
Creating default alias: default -> node (-> v14.4.0)
Now using node v14.4.0 (npm v6.14.5)
/ray/python/ray/dashboard/client /ray
npm WARN prepare removing existing node_modules/ before installation

> core-js@2.6.11 postinstall /ray/python/ray/dashboard/client/node_modules/babel-runtime/node_modules/core-js
> node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js on Open Collective or Patreon: 
> https://opencollective.com/core-js 
> https://www.patreon.com/zloirock 

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)

> fsevents@1.2.12 install /ray/python/ray/dashboard/client/node_modules/webpack-dev-server/node_modules/fsevents
> node-gyp rebuild

gyp ERR! find Python 
gyp ERR! find Python Python is not set from command line or npm configuration
gyp ERR! find Python Python is not set from environment variable PYTHON
gyp ERR! find Python checking if "python" can be used
gyp ERR! find Python - "python" is not in PATH or produced an error
gyp ERR! find Python checking if "python2" can be used
gyp ERR! find Python - "python2" is not in PATH or produced an error
gyp ERR! find Python checking if "python3" can be used
gyp ERR! find Python - executable path is "/usr/bin/python3"
gyp ERR! find Python - version is "3.4.3"
gyp ERR! find Python - version is 3.4.3 - should be ^2.6.0 || >=3.5.0
gyp ERR! find Python - THIS VERSION OF PYTHON IS NOT SUPPORTED
gyp ERR! find Python 
gyp ERR! find Python **********************************************************
gyp ERR! find Python You need to install the latest version of Python.
gyp ERR! find Python Node-gyp should be able to find and use Python. If not,
gyp ERR! find Python you can try one of the following options:
gyp ERR! find Python - Use the switch --python="/path/to/pythonexecutable"
gyp ERR! find Python   (accepted by both node-gyp and npm)
gyp ERR! find Python - Set the environment variable PYTHON
gyp ERR! find Python - Set the npm configuration variable python:
gyp ERR! find Python   npm config set python "/path/to/pythonexecutable"
gyp ERR! find Python For more information consult the documentation at:
gyp ERR! find Python https://github.com/nodejs/node-gyp#installation
gyp ERR! find Python **********************************************************
gyp ERR! find Python 
gyp ERR! configure error 
gyp ERR! stack Error: Could not find any Python installation to use
gyp ERR! stack     at PythonFinder.fail (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:307:47)
gyp ERR! stack     at PythonFinder.runChecks (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:136:21)
gyp ERR! stack     at PythonFinder.<anonymous> (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:243:16)
gyp ERR! stack     at PythonFinder.execFileCallback (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:274:7)
gyp ERR! stack     at ChildProcess.exithandler (child_process.js:294:7)
gyp ERR! stack     at ChildProcess.emit (events.js:315:20)
gyp ERR! stack     at maybeClose (internal/child_process.js:1051:16)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:287:5)
gyp ERR! System Linux 4.19.76-linuxkit
gyp ERR! command "/root/.nvm/versions/node/v14.4.0/bin/node" "/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /ray/python/ray/dashboard/client/node_modules/webpack-dev-server/node_modules/fsevents
gyp ERR! node -v v14.4.0
gyp ERR! node-gyp -v v5.1.0
gyp ERR! not ok 

> fsevents@1.2.12 install /ray/python/ray/dashboard/client/node_modules/watchpack/node_modules/fsevents
> node-gyp rebuild

gyp ERR! find Python 
gyp ERR! find Python Python is not set from command line or npm configuration
gyp ERR! find Python Python is not set from environment variable PYTHON
gyp ERR! find Python checking if "python" can be used
gyp ERR! find Python - "python" is not in PATH or produced an error
gyp ERR! find Python checking if "python2" can be used
gyp ERR! find Python - "python2" is not in PATH or produced an error
gyp ERR! find Python checking if "python3" can be used
gyp ERR! find Python - executable path is "/usr/bin/python3"
gyp ERR! find Python - version is "3.4.3"
gyp ERR! find Python - version is 3.4.3 - should be ^2.6.0 || >=3.5.0
gyp ERR! find Python - THIS VERSION OF PYTHON IS NOT SUPPORTED
gyp ERR! find Python 
gyp ERR! find Python **********************************************************
gyp ERR! find Python You need to install the latest version of Python.
gyp ERR! find Python Node-gyp should be able to find and use Python. If not,
gyp ERR! find Python you can try one of the following options:
gyp ERR! find Python - Use the switch --python="/path/to/pythonexecutable"
gyp ERR! find Python   (accepted by both node-gyp and npm)
gyp ERR! find Python - Set the environment variable PYTHON
gyp ERR! find Python - Set the npm configuration variable python:
gyp ERR! find Python   npm config set python "/path/to/pythonexecutable"
gyp ERR! find Python For more information consult the documentation at:
gyp ERR! find Python https://github.com/nodejs/node-gyp#installation
gyp ERR! find Python **********************************************************
gyp ERR! find Python 
gyp ERR! configure error 
gyp ERR! stack Error: Could not find any Python installation to use
gyp ERR! stack     at PythonFinder.fail (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:307:47)
gyp ERR! stack     at PythonFinder.runChecks (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:136:21)
gyp ERR! stack     at PythonFinder.<anonymous> (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:243:16)
gyp ERR! stack     at PythonFinder.execFileCallback (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:274:7)
gyp ERR! stack     at ChildProcess.exithandler (child_process.js:294:7)
gyp ERR! stack     at ChildProcess.emit (events.js:315:20)
gyp ERR! stack     at maybeClose (internal/child_process.js:1051:16)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:287:5)
gyp ERR! System Linux 4.19.76-linuxkit
gyp ERR! command "/root/.nvm/versions/node/v14.4.0/bin/node" "/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /ray/python/ray/dashboard/client/node_modules/watchpack/node_modules/fsevents
gyp ERR! node -v v14.4.0
gyp ERR! node-gyp -v v5.1.0
gyp ERR! not ok 

> core-js@3.6.4 postinstall /ray/python/ray/dashboard/client/node_modules/core-js
> node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js on Open Collective or Patreon: 
> https://opencollective.com/core-js 
> https://www.patreon.com/zloirock 

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)

> fsevents@1.2.12 install /ray/python/ray/dashboard/client/node_modules/jest-haste-map/node_modules/fsevents
> node-gyp rebuild

gyp ERR! find Python 
gyp ERR! find Python Python is not set from command line or npm configuration
gyp ERR! find Python Python is not set from environment variable PYTHON
gyp ERR! find Python checking if "python" can be used
gyp ERR! find Python - "python" is not in PATH or produced an error
gyp ERR! find Python checking if "python2" can be used
gyp ERR! find Python - "python2" is not in PATH or produced an error
gyp ERR! find Python checking if "python3" can be used
gyp ERR! find Python - executable path is "/usr/bin/python3"
gyp ERR! find Python - version is "3.4.3"
gyp ERR! find Python - version is 3.4.3 - should be ^2.6.0 || >=3.5.0
gyp ERR! find Python - THIS VERSION OF PYTHON IS NOT SUPPORTED
gyp ERR! find Python 
gyp ERR! find Python **********************************************************
gyp ERR! find Python You need to install the latest version of Python.
gyp ERR! find Python Node-gyp should be able to find and use Python. If not,
gyp ERR! find Python you can try one of the following options:
gyp ERR! find Python - Use the switch --python="/path/to/pythonexecutable"
gyp ERR! find Python   (accepted by both node-gyp and npm)
gyp ERR! find Python - Set the environment variable PYTHON
gyp ERR! find Python - Set the npm configuration variable python:
gyp ERR! find Python   npm config set python "/path/to/pythonexecutable"
gyp ERR! find Python For more information consult the documentation at:
gyp ERR! find Python https://github.com/nodejs/node-gyp#installation
gyp ERR! find Python **********************************************************
gyp ERR! find Python 
gyp ERR! configure error 
gyp ERR! stack Error: Could not find any Python installation to use
gyp ERR! stack     at PythonFinder.fail (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:307:47)
gyp ERR! stack     at PythonFinder.runChecks (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:136:21)
gyp ERR! stack     at PythonFinder.<anonymous> (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:243:16)
gyp ERR! stack     at PythonFinder.execFileCallback (/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/lib/find-python.js:274:7)
gyp ERR! stack     at ChildProcess.exithandler (child_process.js:294:7)
gyp ERR! stack     at ChildProcess.emit (events.js:315:20)
gyp ERR! stack     at maybeClose (internal/child_process.js:1051:16)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:287:5)
gyp ERR! System Linux 4.19.76-linuxkit
gyp ERR! command "/root/.nvm/versions/node/v14.4.0/bin/node" "/root/.nvm/versions/node/v14.4.0/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /ray/python/ray/dashboard/client/node_modules/jest-haste-map/node_modules/fsevents
gyp ERR! node -v v14.4.0
gyp ERR! node-gyp -v v5.1.0
gyp ERR! not ok 

> core-js-pure@3.6.4 postinstall /ray/python/ray/dashboard/client/node_modules/core-js-pure
> node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js on Open Collective or Patreon: 
> https://opencollective.com/core-js 
> https://www.patreon.com/zloirock 

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)

added 1716 packages in 298.219s

> client@0.1.0 build /ray/python/ray/dashboard/client
> react-scripts build

Creating an optimized production build...
Compiled successfully.

File sizes after gzip:

  109.72 KB  build/static/js/2.40a67805.chunk.js
  11.73 KB   build/static/js/main.75ff045c.chunk.js
  772 B      build/static/js/runtime-main.cfae3202.js
  583 B      build/static/css/2.47271137.chunk.css

The project was built assuming it is hosted at /.
You can control this with the homepage field in your package.json.

The build folder is ready to be deployed.
You may serve it with a static server:

  npm install -g serve
  serve -s build

Find out more about deployment here:

  bit.ly/CRA-deploy

/ray
+ mkdir -p .whl
+ (( i=0 ))
+ (( i<1 ))
+ PYTHON=cp37-cp37m
+ NUMPY_VERSION=1.14.5
+ git clean -f -f -x -d -e .whl -e python/ray/dashboard/client
Removing build/
Removing python/build/
Removing python/ray.egg-info/
Removing python/ray/pickle5_files/
Removing python/ray/thirdparty_files/
+ pushd python
/ray/python /ray
+ /opt/python/cp37-cp37m/bin/pip install -q numpy==1.14.5 cython==0.29.15
You are using pip version 19.0.3, however version 20.2b1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
+ '[' -n '' ']'
+ echo 'TRAVIS_COMMIT variable not set - required to populated ray.__commit__.'
TRAVIS_COMMIT variable not set - required to populated ray.__commit__.
+ PATH=/opt/python/cp37-cp37m/bin:/root/.nvm/versions/node/v14.4.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/bin
+ /opt/python/cp37-cp37m/bin/python setup.py bdist_wheel
running bdist_wheel
running build
running build_py
creating build
creating build/lib
creating build/lib/ray
copying ray/import_thread.py -> build/lib/ray
copying ray/ray_constants.py -> build/lib/ray
copying ray/worker.py -> build/lib/ray
copying ray/test_utils.py -> build/lib/ray
copying ray/services.py -> build/lib/ray
copying ray/compat.py -> build/lib/ray
copying ray/monitor.py -> build/lib/ray
copying ray/reporter.py -> build/lib/ray
copying ray/function_manager.py -> build/lib/ray
copying ray/__init__.py -> build/lib/ray
copying ray/remote_function.py -> build/lib/ray
copying ray/setup-dev.py -> build/lib/ray
copying ray/ray_perf.py -> build/lib/ray
copying ray/cross_language.py -> build/lib/ray
copying ray/resource_spec.py -> build/lib/ray
copying ray/ray_cluster_perf.py -> build/lib/ray
copying ray/cluster_utils.py -> build/lib/ray
copying ray/utils.py -> build/lib/ray
copying ray/log_monitor.py -> build/lib/ray
copying ray/exceptions.py -> build/lib/ray
copying ray/node.py -> build/lib/ray
copying ray/actor.py -> build/lib/ray
copying ray/signature.py -> build/lib/ray
copying ray/parameter.py -> build/lib/ray
copying ray/async_compat.py -> build/lib/ray
copying ray/memory_monitor.py -> build/lib/ray
copying ray/serialization.py -> build/lib/ray
copying ray/profiling.py -> build/lib/ray
copying ray/state.py -> build/lib/ray
copying ray/gcs_utils.py -> build/lib/ray
copying ray/ray_process_reaper.py -> build/lib/ray
creating build/lib/ray/experimental
copying ray/experimental/queue.py -> build/lib/ray/experimental
copying ray/experimental/dynamic_resources.py -> build/lib/ray/experimental
copying ray/experimental/__init__.py -> build/lib/ray/experimental
copying ray/experimental/api.py -> build/lib/ray/experimental
copying ray/experimental/async_plasma.py -> build/lib/ray/experimental
copying ray/experimental/async_api.py -> build/lib/ray/experimental
copying ray/experimental/internal_kv.py -> build/lib/ray/experimental
copying ray/experimental/tf_utils.py -> build/lib/ray/experimental
creating build/lib/ray/dataframe
copying ray/dataframe/__init__.py -> build/lib/ray/dataframe
creating build/lib/ray/core
copying ray/core/__init__.py -> build/lib/ray/core
creating build/lib/ray/util
copying ray/util/iter.py -> build/lib/ray/util
copying ray/util/timer.py -> build/lib/ray/util
copying ray/util/__init__.py -> build/lib/ray/util
copying ray/util/debug.py -> build/lib/ray/util
copying ray/util/actor_pool.py -> build/lib/ray/util
copying ray/util/named_actors.py -> build/lib/ray/util
copying ray/util/iter_metrics.py -> build/lib/ray/util
creating build/lib/ray/cloudpickle
copying ray/cloudpickle/cloudpickle.py -> build/lib/ray/cloudpickle
copying ray/cloudpickle/__init__.py -> build/lib/ray/cloudpickle
copying ray/cloudpickle/cloudpickle_fast.py -> build/lib/ray/cloudpickle
creating build/lib/ray/projects
copying ray/projects/__init__.py -> build/lib/ray/projects
copying ray/projects/scripts.py -> build/lib/ray/projects
copying ray/projects/projects.py -> build/lib/ray/projects
creating build/lib/ray/internal
copying ray/internal/internal_api.py -> build/lib/ray/internal
copying ray/internal/__init__.py -> build/lib/ray/internal
creating build/lib/ray/streaming
copying ray/streaming/datastream.py -> build/lib/ray/streaming
copying ray/streaming/partition.py -> build/lib/ray/streaming
copying ray/streaming/config.py -> build/lib/ray/streaming
copying ray/streaming/collector.py -> build/lib/ray/streaming
copying ray/streaming/operator.py -> build/lib/ray/streaming
copying ray/streaming/__init__.py -> build/lib/ray/streaming
copying ray/streaming/message.py -> build/lib/ray/streaming
copying ray/streaming/context.py -> build/lib/ray/streaming
copying ray/streaming/function.py -> build/lib/ray/streaming
creating build/lib/ray/dashboard
copying ray/dashboard/node_stats.py -> build/lib/ray/dashboard
copying ray/dashboard/memory.py -> build/lib/ray/dashboard
copying ray/dashboard/util.py -> build/lib/ray/dashboard
copying ray/dashboard/interface.py -> build/lib/ray/dashboard
copying ray/dashboard/__init__.py -> build/lib/ray/dashboard
copying ray/dashboard/dashboard.py -> build/lib/ray/dashboard
creating build/lib/ray/rllib
copying ray/rllib/__init__.py -> build/lib/ray/rllib
copying ray/rllib/rollout.py -> build/lib/ray/rllib
copying ray/rllib/train.py -> build/lib/ray/rllib
copying ray/rllib/scripts.py -> build/lib/ray/rllib
creating build/lib/ray/tune
copying ray/tune/syncer.py -> build/lib/ray/tune
copying ray/tune/trial.py -> build/lib/ray/tune
copying ray/tune/error.py -> build/lib/ray/tune
copying ray/tune/config_parser.py -> build/lib/ray/tune
copying ray/tune/registry.py -> build/lib/ray/tune
copying ray/tune/trial_runner.py -> build/lib/ray/tune
copying ray/tune/stopper.py -> build/lib/ray/tune
copying ray/tune/session.py -> build/lib/ray/tune
copying ray/tune/__init__.py -> build/lib/ray/tune
copying ray/tune/progress_reporter.py -> build/lib/ray/tune
copying ray/tune/web_server.py -> build/lib/ray/tune
copying ray/tune/logger.py -> build/lib/ray/tune
copying ray/tune/ray_trial_executor.py -> build/lib/ray/tune
copying ray/tune/result.py -> build/lib/ray/tune
copying ray/tune/experiment.py -> build/lib/ray/tune
copying ray/tune/function_runner.py -> build/lib/ray/tune
copying ray/tune/tune.py -> build/lib/ray/tune
copying ray/tune/trial_executor.py -> build/lib/ray/tune
copying ray/tune/cluster_info.py -> build/lib/ray/tune
copying ray/tune/sample.py -> build/lib/ray/tune
copying ray/tune/durable_trainable.py -> build/lib/ray/tune
copying ray/tune/resources.py -> build/lib/ray/tune
copying ray/tune/sync_client.py -> build/lib/ray/tune
copying ray/tune/scripts.py -> build/lib/ray/tune
copying ray/tune/trainable.py -> build/lib/ray/tune
copying ray/tune/commands.py -> build/lib/ray/tune
copying ray/tune/checkpoint_manager.py -> build/lib/ray/tune
creating build/lib/ray/scripts
copying ray/scripts/__init__.py -> build/lib/ray/scripts
copying ray/scripts/scripts.py -> build/lib/ray/scripts
creating build/lib/ray/workers
copying ray/workers/__init__.py -> build/lib/ray/workers
copying ray/workers/default_worker.py -> build/lib/ray/workers
creating build/lib/ray/autoscaler
copying ray/autoscaler/tags.py -> build/lib/ray/autoscaler
copying ray/autoscaler/node_launcher.py -> build/lib/ray/autoscaler
copying ray/autoscaler/util.py -> build/lib/ray/autoscaler
copying ray/autoscaler/__init__.py -> build/lib/ray/autoscaler
copying ray/autoscaler/load_metrics.py -> build/lib/ray/autoscaler
copying ray/autoscaler/docker.py -> build/lib/ray/autoscaler
copying ray/autoscaler/updater.py -> build/lib/ray/autoscaler
copying ray/autoscaler/log_timer.py -> build/lib/ray/autoscaler
copying ray/autoscaler/autoscaler.py -> build/lib/ray/autoscaler
copying ray/autoscaler/node_provider.py -> build/lib/ray/autoscaler
copying ray/autoscaler/commands.py -> build/lib/ray/autoscaler
creating build/lib/ray/serve
copying ray/serve/config.py -> build/lib/ray/serve
copying ray/serve/http_util.py -> build/lib/ray/serve
copying ray/serve/request_params.py -> build/lib/ray/serve
copying ray/serve/handle.py -> build/lib/ray/serve
copying ray/serve/constants.py -> build/lib/ray/serve
copying ray/serve/http_proxy.py -> build/lib/ray/serve
copying ray/serve/policy.py -> build/lib/ray/serve
copying ray/serve/__init__.py -> build/lib/ray/serve
copying ray/serve/api.py -> build/lib/ray/serve
copying ray/serve/context.py -> build/lib/ray/serve
copying ray/serve/master.py -> build/lib/ray/serve
copying ray/serve/utils.py -> build/lib/ray/serve
copying ray/serve/exceptions.py -> build/lib/ray/serve
copying ray/serve/router.py -> build/lib/ray/serve
copying ray/serve/backend_worker.py -> build/lib/ray/serve
copying ray/serve/kv_store.py -> build/lib/ray/serve
creating build/lib/ray/experimental/array
copying ray/experimental/array/__init__.py -> build/lib/ray/experimental/array
creating build/lib/ray/experimental/multiprocessing
copying ray/experimental/multiprocessing/__init__.py -> build/lib/ray/experimental/multiprocessing
copying ray/experimental/multiprocessing/pool.py -> build/lib/ray/experimental/multiprocessing
creating build/lib/ray/experimental/array/distributed
copying ray/experimental/array/distributed/__init__.py -> build/lib/ray/experimental/array/distributed
copying ray/experimental/array/distributed/core.py -> build/lib/ray/experimental/array/distributed
copying ray/experimental/array/distributed/random.py -> build/lib/ray/experimental/array/distributed
copying ray/experimental/array/distributed/linalg.py -> build/lib/ray/experimental/array/distributed
creating build/lib/ray/experimental/array/remote
copying ray/experimental/array/remote/__init__.py -> build/lib/ray/experimental/array/remote
copying ray/experimental/array/remote/core.py -> build/lib/ray/experimental/array/remote
copying ray/experimental/array/remote/random.py -> build/lib/ray/experimental/array/remote
copying ray/experimental/array/remote/linalg.py -> build/lib/ray/experimental/array/remote
creating build/lib/ray/core/generated
copying ray/core/generated/__init__.py -> build/lib/ray/core/generated
creating build/lib/ray/core/src
copying ray/core/src/__init__.py -> build/lib/ray/core/src
creating build/lib/ray/core/src/plasma
copying ray/core/src/plasma/__init__.py -> build/lib/ray/core/src/plasma
creating build/lib/ray/core/src/ray
copying ray/core/src/ray/__init__.py -> build/lib/ray/core/src/ray
creating build/lib/ray/core/src/ray/raylet
copying ray/core/src/ray/raylet/__init__.py -> build/lib/ray/core/src/ray/raylet
creating build/lib/ray/util/multiprocessing
copying ray/util/multiprocessing/__init__.py -> build/lib/ray/util/multiprocessing
copying ray/util/multiprocessing/pool.py -> build/lib/ray/util/multiprocessing
creating build/lib/ray/util/joblib
copying ray/util/joblib/__init__.py -> build/lib/ray/util/joblib
copying ray/util/joblib/ray_backend.py -> build/lib/ray/util/joblib
creating build/lib/ray/util/sgd
copying ray/util/sgd/__init__.py -> build/lib/ray/util/sgd
copying ray/util/sgd/utils.py -> build/lib/ray/util/sgd
creating build/lib/ray/util/sgd/torch
copying ray/util/sgd/torch/constants.py -> build/lib/ray/util/sgd/torch
copying ray/util/sgd/torch/distributed_torch_runner.py -> build/lib/ray/util/sgd/torch
copying ray/util/sgd/torch/__init__.py -> build/lib/ray/util/sgd/torch
copying ray/util/sgd/torch/training_operator.py -> build/lib/ray/util/sgd/torch
copying ray/util/sgd/torch/resnet.py -> build/lib/ray/util/sgd/torch
copying ray/util/sgd/torch/torch_trainer.py -> build/lib/ray/util/sgd/torch
copying ray/util/sgd/torch/torch_runner.py -> build/lib/ray/util/sgd/torch
creating build/lib/ray/util/sgd/data
copying ray/util/sgd/data/__init__.py -> build/lib/ray/util/sgd/data
copying ray/util/sgd/data/dataset.py -> build/lib/ray/util/sgd/data
creating build/lib/ray/util/sgd/tf
copying ray/util/sgd/tf/__init__.py -> build/lib/ray/util/sgd/tf
copying ray/util/sgd/tf/tf_runner.py -> build/lib/ray/util/sgd/tf
copying ray/util/sgd/tf/tf_trainer.py -> build/lib/ray/util/sgd/tf
creating build/lib/ray/util/sgd/torch/examples
copying ray/util/sgd/torch/examples/cifar_pytorch_example.py -> build/lib/ray/util/sgd/torch/examples
copying ray/util/sgd/torch/examples/raysgd_torch_signatures.py -> build/lib/ray/util/sgd/torch/examples
copying ray/util/sgd/torch/examples/__init__.py -> build/lib/ray/util/sgd/torch/examples
copying ray/util/sgd/torch/examples/cifar_pytorch_pbt.py -> build/lib/ray/util/sgd/torch/examples
copying ray/util/sgd/torch/examples/dcgan.py -> build/lib/ray/util/sgd/torch/examples
copying ray/util/sgd/torch/examples/tune_example.py -> build/lib/ray/util/sgd/torch/examples
copying ray/util/sgd/torch/examples/train_example.py -> build/lib/ray/util/sgd/torch/examples
creating build/lib/ray/util/sgd/torch/examples/image_models
copying ray/util/sgd/torch/examples/image_models/util.py -> build/lib/ray/util/sgd/torch/examples/image_models
copying ray/util/sgd/torch/examples/image_models/__init__.py -> build/lib/ray/util/sgd/torch/examples/image_models
copying ray/util/sgd/torch/examples/image_models/train.py -> build/lib/ray/util/sgd/torch/examples/image_models
copying ray/util/sgd/torch/examples/image_models/args.py -> build/lib/ray/util/sgd/torch/examples/image_models
creating build/lib/ray/util/sgd/torch/examples/segmentation
copying ray/util/sgd/torch/examples/segmentation/transforms.py -> build/lib/ray/util/sgd/torch/examples/segmentation
copying ray/util/sgd/torch/examples/segmentation/__init__.py -> build/lib/ray/util/sgd/torch/examples/segmentation
copying ray/util/sgd/torch/examples/segmentation/utils.py -> build/lib/ray/util/sgd/torch/examples/segmentation
copying ray/util/sgd/torch/examples/segmentation/train_segmentation.py -> build/lib/ray/util/sgd/torch/examples/segmentation
copying ray/util/sgd/torch/examples/segmentation/coco_utils.py -> build/lib/ray/util/sgd/torch/examples/segmentation
creating build/lib/ray/util/sgd/torch/examples/transformers
copying ray/util/sgd/torch/examples/transformers/transformers_example.py -> build/lib/ray/util/sgd/torch/examples/transformers
copying ray/util/sgd/torch/examples/transformers/__init__.py -> build/lib/ray/util/sgd/torch/examples/transformers
copying ray/util/sgd/torch/examples/transformers/utils.py -> build/lib/ray/util/sgd/torch/examples/transformers
creating build/lib/ray/util/sgd/data/examples
copying ray/util/sgd/data/examples/mlp_identity.py -> build/lib/ray/util/sgd/data/examples
copying ray/util/sgd/data/examples/__init__.py -> build/lib/ray/util/sgd/data/examples
creating build/lib/ray/streaming/runtime
copying ray/streaming/runtime/worker.py -> build/lib/ray/streaming/runtime
copying ray/streaming/runtime/gateway_client.py -> build/lib/ray/streaming/runtime
copying ray/streaming/runtime/task.py -> build/lib/ray/streaming/runtime
copying ray/streaming/runtime/graph.py -> build/lib/ray/streaming/runtime
copying ray/streaming/runtime/__init__.py -> build/lib/ray/streaming/runtime
copying ray/streaming/runtime/processor.py -> build/lib/ray/streaming/runtime
copying ray/streaming/runtime/transfer.py -> build/lib/ray/streaming/runtime
copying ray/streaming/runtime/serialization.py -> build/lib/ray/streaming/runtime
creating build/lib/ray/streaming/tests
copying ray/streaming/tests/test_word_count.py -> build/lib/ray/streaming/tests
copying ray/streaming/tests/test_operator.py -> build/lib/ray/streaming/tests
copying ray/streaming/tests/test_direct_transfer.py -> build/lib/ray/streaming/tests
copying ray/streaming/tests/__init__.py -> build/lib/ray/streaming/tests
copying ray/streaming/tests/test_union_stream.py -> build/lib/ray/streaming/tests
copying ray/streaming/tests/test_function.py -> build/lib/ray/streaming/tests
copying ray/streaming/tests/test_hybrid_stream.py -> build/lib/ray/streaming/tests
copying ray/streaming/tests/test_serialization.py -> build/lib/ray/streaming/tests
copying ray/streaming/tests/test_stream.py -> build/lib/ray/streaming/tests
creating build/lib/ray/dashboard/metrics_exporter
copying ray/dashboard/metrics_exporter/client.py -> build/lib/ray/dashboard/metrics_exporter
copying ray/dashboard/metrics_exporter/actions.py -> build/lib/ray/dashboard/metrics_exporter
copying ray/dashboard/metrics_exporter/__init__.py -> build/lib/ray/dashboard/metrics_exporter
copying ray/dashboard/metrics_exporter/api.py -> build/lib/ray/dashboard/metrics_exporter
copying ray/dashboard/metrics_exporter/schema.py -> build/lib/ray/dashboard/metrics_exporter
creating build/lib/ray/rllib/tests
copying ray/rllib/tests/test_dependency_torch.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/conftest.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_evaluators.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_catalog.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_eager_support.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_external_multi_agent_env.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_checkpoint_restore.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_perf.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_supported_multi_agent.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_exec_api.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/mock_worker.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/__init__.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_env_with_subprocess.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_attention_net_learning.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_external_env.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_io.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_dependency.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_rollout.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_nested_observation_spaces.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_execution.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_avail_actions_qmix.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_ignore_worker_failure.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_multi_agent_pendulum.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_local.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_rollout_worker.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_multi_agent_env.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_model_imports.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_filters.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_supported_spaces.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_lstm.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_reproducibility.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/test_export.py -> build/lib/ray/rllib/tests
copying ray/rllib/tests/run_regression_tests.py -> build/lib/ray/rllib/tests
creating build/lib/ray/rllib/agents
copying ray/rllib/agents/registry.py -> build/lib/ray/rllib/agents
copying ray/rllib/agents/trainer_template.py -> build/lib/ray/rllib/agents
copying ray/rllib/agents/__init__.py -> build/lib/ray/rllib/agents
copying ray/rllib/agents/callbacks.py -> build/lib/ray/rllib/agents
copying ray/rllib/agents/agent.py -> build/lib/ray/rllib/agents
copying ray/rllib/agents/trainer.py -> build/lib/ray/rllib/agents
copying ray/rllib/agents/mock.py -> build/lib/ray/rllib/agents
creating build/lib/ray/rllib/utils
copying ray/rllib/utils/test_utils.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/window_stat.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/error.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/tuple_actions.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/memory.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/deprecation.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/timer.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/compression.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/tracking_dict.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/sgd.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/explained_variance.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/framework.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/__init__.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/numpy.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/from_config.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/seed.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/debug.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/filter_manager.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/tf_ops.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/policy_server.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/torch_ops.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/filter.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/actors.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/annotations.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/policy_client.py -> build/lib/ray/rllib/utils
copying ray/rllib/utils/tf_run_builder.py -> build/lib/ray/rllib/utils
creating build/lib/ray/rllib/models
copying ray/rllib/models/catalog.py -> build/lib/ray/rllib/models
copying ray/rllib/models/modelv2.py -> build/lib/ray/rllib/models
copying ray/rllib/models/__init__.py -> build/lib/ray/rllib/models
copying ray/rllib/models/model.py -> build/lib/ray/rllib/models
copying ray/rllib/models/repeated_values.py -> build/lib/ray/rllib/models
copying ray/rllib/models/preprocessors.py -> build/lib/ray/rllib/models
copying ray/rllib/models/action_dist.py -> build/lib/ray/rllib/models
creating build/lib/ray/rllib/contrib
copying ray/rllib/contrib/registry.py -> build/lib/ray/rllib/contrib
copying ray/rllib/contrib/__init__.py -> build/lib/ray/rllib/contrib
creating build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/multi_gpu_impl.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/async_gradients_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/async_samples_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/torch_distributed_data_parallel_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/aso_tree_aggregator.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/aso_minibatch_buffer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/aso_learner.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/__init__.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/aso_aggregator.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/segment_tree.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/policy_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/rollout.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/microbatch_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/sync_samples_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/replay_buffer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/sync_replay_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/aso_multi_gpu_learner.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/async_replay_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/sync_batch_replay_optimizer.py -> build/lib/ray/rllib/optimizers
copying ray/rllib/optimizers/multi_gpu_optimizer.py -> build/lib/ray/rllib/optimizers
creating build/lib/ray/rllib/env
copying ray/rllib/env/dm_env_wrapper.py -> build/lib/ray/rllib/env
copying ray/rllib/env/policy_server_input.py -> build/lib/ray/rllib/env
copying ray/rllib/env/group_agents_wrapper.py -> build/lib/ray/rllib/env
copying ray/rllib/env/atari_wrappers.py -> build/lib/ray/rllib/env
copying ray/rllib/env/vector_env.py -> build/lib/ray/rllib/env
copying ray/rllib/env/env_context.py -> build/lib/ray/rllib/env
copying ray/rllib/env/constants.py -> build/lib/ray/rllib/env
copying ray/rllib/env/normalize_actions.py -> build/lib/ray/rllib/env
copying ray/rllib/env/__init__.py -> build/lib/ray/rllib/env
copying ray/rllib/env/multi_agent_env.py -> build/lib/ray/rllib/env
copying ray/rllib/env/base_env.py -> build/lib/ray/rllib/env
copying ray/rllib/env/unity3d_env.py -> build/lib/ray/rllib/env
copying ray/rllib/env/external_env.py -> build/lib/ray/rllib/env
copying ray/rllib/env/external_multi_agent_env.py -> build/lib/ray/rllib/env
copying ray/rllib/env/remote_vector_env.py -> build/lib/ray/rllib/env
copying ray/rllib/env/policy_client.py -> build/lib/ray/rllib/env
creating build/lib/ray/rllib/execution
copying ray/rllib/execution/multi_gpu_learner.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/rollout_ops.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/multi_gpu_impl.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/train_ops.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/concurrency_ops.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/replay_ops.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/__init__.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/common.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/segment_tree.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/tree_agg.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/minibatch_buffer.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/replay_buffer.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/metric_ops.py -> build/lib/ray/rllib/execution
copying ray/rllib/execution/learner_thread.py -> build/lib/ray/rllib/execution
creating build/lib/ray/rllib/examples
copying ray/rllib/examples/nested_action_spaces.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/cartpole_lstm.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_train_fn.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_metrics_and_callbacks.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_fast_model.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/attention_net.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/batch_norm_model.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/parametric_actions_cartpole.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/attention_net_supervised.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_torch_policy.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/__init__.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/twostep_game.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/eager_execution.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/multi_agent_cartpole.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/unity3d_env_local.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/complex_struct_space.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/multi_agent_custom_policy.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_loss.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/hierarchical_training.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/autoregressive_action_dist.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_metrics_and_callbacks_legacy.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/multi_agent_two_trainers.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/mobilenet_v2_with_lstm.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/rock_paper_scissors_multiagent.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/saving_experiences.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/dmlab_watermaze.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/centralized_critic_2.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_rnn_model.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_eval.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/two_trainer_workflow.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/centralized_critic.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/rollout_worker_custom_workflow.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_tf_policy.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_keras_model.py -> build/lib/ray/rllib/examples
copying ray/rllib/examples/custom_env.py -> build/lib/ray/rllib/examples
creating build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/metrics.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/rollout_worker.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/episode.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/rollout_metrics.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/__init__.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/sample_batch_builder.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/worker_set.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/postprocessing.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/sampler.py -> build/lib/ray/rllib/evaluation
copying ray/rllib/evaluation/observation_function.py -> build/lib/ray/rllib/evaluation
creating build/lib/ray/rllib/policy
copying ray/rllib/policy/dynamic_tf_policy.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/rnn_sequencing.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/torch_policy_template.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/policy.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/__init__.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/tf_policy_template.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/sample_batch.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/tf_policy.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/torch_policy.py -> build/lib/ray/rllib/policy
copying ray/rllib/policy/eager_tf_policy.py -> build/lib/ray/rllib/policy
creating build/lib/ray/rllib/offline
copying ray/rllib/offline/shuffled_input.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/wis_estimator.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/output_writer.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/__init__.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/off_policy_estimator.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/input_reader.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/mixed_input.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/json_writer.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/is_estimator.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/io_context.py -> build/lib/ray/rllib/offline
copying ray/rllib/offline/json_reader.py -> build/lib/ray/rllib/offline
creating build/lib/ray/rllib/agents/a3c
copying ray/rllib/agents/a3c/__init__.py -> build/lib/ray/rllib/agents/a3c
copying ray/rllib/agents/a3c/a3c_tf_policy.py -> build/lib/ray/rllib/agents/a3c
copying ray/rllib/agents/a3c/a3c_torch_policy.py -> build/lib/ray/rllib/agents/a3c
copying ray/rllib/agents/a3c/a3c.py -> build/lib/ray/rllib/agents/a3c
copying ray/rllib/agents/a3c/a2c.py -> build/lib/ray/rllib/agents/a3c
creating build/lib/ray/rllib/agents/sac
copying ray/rllib/agents/sac/sac_tf_policy.py -> build/lib/ray/rllib/agents/sac
copying ray/rllib/agents/sac/__init__.py -> build/lib/ray/rllib/agents/sac
copying ray/rllib/agents/sac/sac_torch_policy.py -> build/lib/ray/rllib/agents/sac
copying ray/rllib/agents/sac/sac.py -> build/lib/ray/rllib/agents/sac
copying ray/rllib/agents/sac/sac_tf_model.py -> build/lib/ray/rllib/agents/sac
copying ray/rllib/agents/sac/sac_torch_model.py -> build/lib/ray/rllib/agents/sac
creating build/lib/ray/rllib/agents/ars
copying ray/rllib/agents/ars/ars.py -> build/lib/ray/rllib/agents/ars
copying ray/rllib/agents/ars/__init__.py -> build/lib/ray/rllib/agents/ars
copying ray/rllib/agents/ars/ars_torch_policy.py -> build/lib/ray/rllib/agents/ars
copying ray/rllib/agents/ars/ars_tf_policy.py -> build/lib/ray/rllib/agents/ars
creating build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/apex.py -> build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/ddpg_tf_model.py -> build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/ddpg_torch_model.py -> build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/td3.py -> build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/noop_model.py -> build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/ddpg_torch_policy.py -> build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/__init__.py -> build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/ddpg_tf_policy.py -> build/lib/ray/rllib/agents/ddpg
copying ray/rllib/agents/ddpg/ddpg.py -> build/lib/ray/rllib/agents/ddpg
creating build/lib/ray/rllib/agents/impala
copying ray/rllib/agents/impala/vtrace_tf.py -> build/lib/ray/rllib/agents/impala
copying ray/rllib/agents/impala/__init__.py -> build/lib/ray/rllib/agents/impala
copying ray/rllib/agents/impala/vtrace_torch_policy.py -> build/lib/ray/rllib/agents/impala
copying ray/rllib/agents/impala/vtrace_torch.py -> build/lib/ray/rllib/agents/impala
copying ray/rllib/agents/impala/impala.py -> build/lib/ray/rllib/agents/impala
copying ray/rllib/agents/impala/vtrace_tf_policy.py -> build/lib/ray/rllib/agents/impala
creating build/lib/ray/rllib/agents/pg
copying ray/rllib/agents/pg/pg.py -> build/lib/ray/rllib/agents/pg
copying ray/rllib/agents/pg/pg_tf_policy.py -> build/lib/ray/rllib/agents/pg
copying ray/rllib/agents/pg/__init__.py -> build/lib/ray/rllib/agents/pg
copying ray/rllib/agents/pg/pg_torch_policy.py -> build/lib/ray/rllib/agents/pg
creating build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/dqn_tf_policy.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/apex.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/simple_q.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/distributional_q_tf_model.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/dqn_torch_policy.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/simple_q_tf_policy.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/simple_q_model.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/__init__.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/simple_q_torch_policy.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/dqn_torch_model.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/learner_thread.py -> build/lib/ray/rllib/agents/dqn
copying ray/rllib/agents/dqn/dqn.py -> build/lib/ray/rllib/agents/dqn
creating build/lib/ray/rllib/agents/es
copying ray/rllib/agents/es/es_tf_policy.py -> build/lib/ray/rllib/agents/es
copying ray/rllib/agents/es/__init__.py -> build/lib/ray/rllib/agents/es
copying ray/rllib/agents/es/optimizers.py -> build/lib/ray/rllib/agents/es
copying ray/rllib/agents/es/utils.py -> build/lib/ray/rllib/agents/es
copying ray/rllib/agents/es/es.py -> build/lib/ray/rllib/agents/es
copying ray/rllib/agents/es/es_torch_policy.py -> build/lib/ray/rllib/agents/es
creating build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/ddppo.py -> build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/ppo_tf_policy.py -> build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/appo_tf_policy.py -> build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/appo.py -> build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/__init__.py -> build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/utils.py -> build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/appo_torch_policy.py -> build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/ppo_torch_policy.py -> build/lib/ray/rllib/agents/ppo
copying ray/rllib/agents/ppo/ppo.py -> build/lib/ray/rllib/agents/ppo
creating build/lib/ray/rllib/agents/qmix
copying ray/rllib/agents/qmix/qmix_policy.py -> build/lib/ray/rllib/agents/qmix
copying ray/rllib/agents/qmix/__init__.py -> build/lib/ray/rllib/agents/qmix
copying ray/rllib/agents/qmix/model.py -> build/lib/ray/rllib/agents/qmix
copying ray/rllib/agents/qmix/mixers.py -> build/lib/ray/rllib/agents/qmix
copying ray/rllib/agents/qmix/qmix.py -> build/lib/ray/rllib/agents/qmix
creating build/lib/ray/rllib/agents/marwil
copying ray/rllib/agents/marwil/marwil.py -> build/lib/ray/rllib/agents/marwil
copying ray/rllib/agents/marwil/__init__.py -> build/lib/ray/rllib/agents/marwil
copying ray/rllib/agents/marwil/marwil_torch_policy.py -> build/lib/ray/rllib/agents/marwil
copying ray/rllib/agents/marwil/marwil_tf_policy.py -> build/lib/ray/rllib/agents/marwil
creating build/lib/ray/rllib/agents/ddpg/common
copying ray/rllib/agents/ddpg/common/__init__.py -> build/lib/ray/rllib/agents/ddpg/common
creating build/lib/ray/rllib/agents/dqn/common
copying ray/rllib/agents/dqn/common/__init__.py -> build/lib/ray/rllib/agents/dqn/common
creating build/lib/ray/rllib/utils/tests
copying ray/rllib/utils/tests/test_taskpool.py -> build/lib/ray/rllib/utils/tests
copying ray/rllib/utils/tests/__init__.py -> build/lib/ray/rllib/utils/tests
copying ray/rllib/utils/tests/test_framework_agnostic_components.py -> build/lib/ray/rllib/utils/tests
creating build/lib/ray/rllib/utils/spaces
copying ray/rllib/utils/spaces/__init__.py -> build/lib/ray/rllib/utils/spaces
copying ray/rllib/utils/spaces/space_utils.py -> build/lib/ray/rllib/utils/spaces
copying ray/rllib/utils/spaces/repeated.py -> build/lib/ray/rllib/utils/spaces
copying ray/rllib/utils/spaces/simplex.py -> build/lib/ray/rllib/utils/spaces
creating build/lib/ray/rllib/utils/schedules
copying ray/rllib/utils/schedules/piecewise_schedule.py -> build/lib/ray/rllib/utils/schedules
copying ray/rllib/utils/schedules/constant_schedule.py -> build/lib/ray/rllib/utils/schedules
copying ray/rllib/utils/schedules/linear_schedule.py -> build/lib/ray/rllib/utils/schedules
copying ray/rllib/utils/schedules/__init__.py -> build/lib/ray/rllib/utils/schedules
copying ray/rllib/utils/schedules/polynomial_schedule.py -> build/lib/ray/rllib/utils/schedules
copying ray/rllib/utils/schedules/exponential_schedule.py -> build/lib/ray/rllib/utils/schedules
copying ray/rllib/utils/schedules/schedule.py -> build/lib/ray/rllib/utils/schedules
creating build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/per_worker_ornstein_uhlenbeck_noise.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/per_worker_gaussian_noise.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/exploration.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/ornstein_uhlenbeck_noise.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/per_worker_epsilon_greedy.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/stochastic_sampling.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/__init__.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/soft_q.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/random.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/parameter_noise.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/epsilon_greedy.py -> build/lib/ray/rllib/utils/exploration
copying ray/rllib/utils/exploration/gaussian_noise.py -> build/lib/ray/rllib/utils/exploration
creating build/lib/ray/rllib/models/torch
copying ray/rllib/models/torch/recurrent_net.py -> build/lib/ray/rllib/models/torch
copying ray/rllib/models/torch/misc.py -> build/lib/ray/rllib/models/torch
copying ray/rllib/models/torch/attention_net.py -> build/lib/ray/rllib/models/torch
copying ray/rllib/models/torch/visionnet.py -> build/lib/ray/rllib/models/torch
copying ray/rllib/models/torch/torch_modelv2.py -> build/lib/ray/rllib/models/torch
copying ray/rllib/models/torch/__init__.py -> build/lib/ray/rllib/models/torch
copying ray/rllib/models/torch/fcnet.py -> build/lib/ray/rllib/models/torch
copying ray/rllib/models/torch/torch_action_dist.py -> build/lib/ray/rllib/models/torch
creating build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/tf_modelv2.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/recurrent_net.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/modelv1_compat.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/misc.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/visionnet_v2.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/attention_net.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/visionnet.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/fcnet_v1.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/__init__.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/tf_action_dist.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/recurrent_tf_model_v2.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/fcnet_v2.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/lstm_v1.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/visionnet_v1.py -> build/lib/ray/rllib/models/tf
copying ray/rllib/models/tf/fcnet.py -> build/lib/ray/rllib/models/tf
creating build/lib/ray/rllib/models/tf/layers
copying ray/rllib/models/tf/layers/skip_connection.py -> build/lib/ray/rllib/models/tf/layers
copying ray/rllib/models/tf/layers/relative_multi_head_attention.py -> build/lib/ray/rllib/models/tf/layers
copying ray/rllib/models/tf/layers/__init__.py -> build/lib/ray/rllib/models/tf/layers
copying ray/rllib/models/tf/layers/gru_gate.py -> build/lib/ray/rllib/models/tf/layers
copying ray/rllib/models/tf/layers/multi_head_attention.py -> build/lib/ray/rllib/models/tf/layers
creating build/lib/ray/rllib/contrib/maddpg
copying ray/rllib/contrib/maddpg/maddpg_policy.py -> build/lib/ray/rllib/contrib/maddpg
copying ray/rllib/contrib/maddpg/__init__.py -> build/lib/ray/rllib/contrib/maddpg
copying ray/rllib/contrib/maddpg/maddpg.py -> build/lib/ray/rllib/contrib/maddpg
creating build/lib/ray/rllib/contrib/bandits
copying ray/rllib/contrib/bandits/exploration.py -> build/lib/ray/rllib/contrib/bandits
copying ray/rllib/contrib/bandits/__init__.py -> build/lib/ray/rllib/contrib/bandits
creating build/lib/ray/rllib/contrib/alpha_zero
copying ray/rllib/contrib/alpha_zero/__init__.py -> build/lib/ray/rllib/contrib/alpha_zero
creating build/lib/ray/rllib/contrib/bandits/agents
copying ray/rllib/contrib/bandits/agents/policy.py -> build/lib/ray/rllib/contrib/bandits/agents
copying ray/rllib/contrib/bandits/agents/lin_ucb.py -> build/lib/ray/rllib/contrib/bandits/agents
copying ray/rllib/contrib/bandits/agents/lin_ts.py -> build/lib/ray/rllib/contrib/bandits/agents
copying ray/rllib/contrib/bandits/agents/__init__.py -> build/lib/ray/rllib/contrib/bandits/agents
creating build/lib/ray/rllib/contrib/bandits/models
copying ray/rllib/contrib/bandits/models/__init__.py -> build/lib/ray/rllib/contrib/bandits/models
copying ray/rllib/contrib/bandits/models/linear_regression.py -> build/lib/ray/rllib/contrib/bandits/models
creating build/lib/ray/rllib/contrib/bandits/envs
copying ray/rllib/contrib/bandits/envs/parametric.py -> build/lib/ray/rllib/contrib/bandits/envs
copying ray/rllib/contrib/bandits/envs/discrete.py -> build/lib/ray/rllib/contrib/bandits/envs
copying ray/rllib/contrib/bandits/envs/__init__.py -> build/lib/ray/rllib/contrib/bandits/envs
creating build/lib/ray/rllib/contrib/alpha_zero/core
copying ray/rllib/contrib/alpha_zero/core/__init__.py -> build/lib/ray/rllib/contrib/alpha_zero/core
copying ray/rllib/contrib/alpha_zero/core/ranked_rewards.py -> build/lib/ray/rllib/contrib/alpha_zero/core
copying ray/rllib/contrib/alpha_zero/core/alpha_zero_trainer.py -> build/lib/ray/rllib/contrib/alpha_zero/core
copying ray/rllib/contrib/alpha_zero/core/alpha_zero_policy.py -> build/lib/ray/rllib/contrib/alpha_zero/core
copying ray/rllib/contrib/alpha_zero/core/mcts.py -> build/lib/ray/rllib/contrib/alpha_zero/core
creating build/lib/ray/rllib/contrib/alpha_zero/optimizer
copying ray/rllib/contrib/alpha_zero/optimizer/__init__.py -> build/lib/ray/rllib/contrib/alpha_zero/optimizer
creating build/lib/ray/rllib/contrib/alpha_zero/environments
copying ray/rllib/contrib/alpha_zero/environments/__init__.py -> build/lib/ray/rllib/contrib/alpha_zero/environments
copying ray/rllib/contrib/alpha_zero/environments/cartpole.py -> build/lib/ray/rllib/contrib/alpha_zero/environments
creating build/lib/ray/rllib/contrib/alpha_zero/models
copying ray/rllib/contrib/alpha_zero/models/custom_torch_models.py -> build/lib/ray/rllib/contrib/alpha_zero/models
copying ray/rllib/contrib/alpha_zero/models/__init__.py -> build/lib/ray/rllib/contrib/alpha_zero/models
creating build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/fast_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/batch_norm_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/mobilenet_v2_with_lstm_models.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/simple_rpg_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/__init__.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/centralized_critic_models.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/shared_weights_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/autoregressive_action_dist.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/rnn_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/eager_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/custom_loss_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/parametric_actions_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/rnn_spy_model.py -> build/lib/ray/rllib/examples/models
copying ray/rllib/examples/models/autoregressive_action_model.py -> build/lib/ray/rllib/examples/models
creating build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/debug_counter_env.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/two_step_game.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/simple_corridor.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/env_with_subprocess.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/repeat_initial_obs_env.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/parametric_actions_cartpole.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/stateless_cartpole.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/nested_space_repeat_after_me_env.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/multi_agent.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/__init__.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/rock_paper_scissors.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/random_env.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/simple_rpg.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/repeat_after_me_env.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/windy_maze_env.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/correlated_actions_env.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/fast_image_env.py -> build/lib/ray/rllib/examples/env
copying ray/rllib/examples/env/look_and_push.py -> build/lib/ray/rllib/examples/env
creating build/lib/ray/rllib/examples/policy
copying ray/rllib/examples/policy/rock_paper_scissors_dummies.py -> build/lib/ray/rllib/examples/policy
copying ray/rllib/examples/policy/random_policy.py -> build/lib/ray/rllib/examples/policy
copying ray/rllib/examples/policy/__init__.py -> build/lib/ray/rllib/examples/policy
creating build/lib/ray/rllib/policy/tests
copying ray/rllib/policy/tests/__init__.py -> build/lib/ray/rllib/policy/tests
copying ray/rllib/policy/tests/test_compute_log_likelihoods.py -> build/lib/ray/rllib/policy/tests
copying ray/rllib/policy/tests/OBSOLETE_test_policy.py -> build/lib/ray/rllib/policy/tests
creating build/lib/ray/tune/suggest
copying ray/tune/suggest/hyperopt.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/dragonfly.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/variant_generator.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/suggestion.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/bohb.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/sigopt.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/zoopt.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/__init__.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/bayesopt.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/skopt.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/nevergrad.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/search.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/repeater.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/basic_variant.py -> build/lib/ray/tune/suggest
copying ray/tune/suggest/ax.py -> build/lib/ray/tune/suggest
creating build/lib/ray/tune/track
copying ray/tune/track/session.py -> build/lib/ray/tune/track
copying ray/tune/track/__init__.py -> build/lib/ray/tune/track
creating build/lib/ray/tune/analysis
copying ray/tune/analysis/__init__.py -> build/lib/ray/tune/analysis
copying ray/tune/analysis/experiment_analysis.py -> build/lib/ray/tune/analysis
creating build/lib/ray/tune/integration
copying ray/tune/integration/keras.py -> build/lib/ray/tune/integration
copying ray/tune/integration/__init__.py -> build/lib/ray/tune/integration
creating build/lib/ray/tune/utils
copying ray/tune/utils/util.py -> build/lib/ray/tune/utils
copying ray/tune/utils/__init__.py -> build/lib/ray/tune/utils
copying ray/tune/utils/visual_utils.py -> build/lib/ray/tune/utils
copying ray/tune/utils/mock.py -> build/lib/ray/tune/utils
creating build/lib/ray/tune/automl
copying ray/tune/automl/__init__.py -> build/lib/ray/tune/automl
copying ray/tune/automl/search_policy.py -> build/lib/ray/tune/automl
copying ray/tune/automl/search_space.py -> build/lib/ray/tune/automl
copying ray/tune/automl/genetic_searcher.py -> build/lib/ray/tune/automl
creating build/lib/ray/tune/examples
copying ray/tune/examples/durable_trainable_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/mlflow_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/pbt_ppo_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/sigopt_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/tune_cifar10_gluon.py -> build/lib/ray/tune/examples
copying ray/tune/examples/pbt_tune_cifar10_with_keras.py -> build/lib/ray/tune/examples
copying ray/tune/examples/pbt_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/bohb_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/bayesopt_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/tune_mnist_keras.py -> build/lib/ray/tune/examples
copying ray/tune/examples/mnist_pytorch.py -> build/lib/ray/tune/examples
copying ray/tune/examples/dragonfly_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/genetic_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/pbt_convnet_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/zoopt_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/skopt_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/__init__.py -> build/lib/ray/tune/examples
copying ray/tune/examples/tf_mnist_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/lightgbm_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/hyperopt_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/utils.py -> build/lib/ray/tune/examples
copying ray/tune/examples/nevergrad_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/mnist_pytorch_trainable.py -> build/lib/ray/tune/examples
copying ray/tune/examples/xgboost_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/async_hyperband_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/ax_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/logging_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/pbt_memnn_example.py -> build/lib/ray/tune/examples
copying ray/tune/examples/hyperband_example.py -> build/lib/ray/tune/examples
creating build/lib/ray/tune/automlboard
copying ray/tune/automlboard/run.py -> build/lib/ray/tune/automlboard
copying ray/tune/automlboard/__init__.py -> build/lib/ray/tune/automlboard
copying ray/tune/automlboard/settings.py -> build/lib/ray/tune/automlboard
copying ray/tune/automlboard/manage.py -> build/lib/ray/tune/automlboard
creating build/lib/ray/tune/schedulers
copying ray/tune/schedulers/pbt.py -> build/lib/ray/tune/schedulers
copying ray/tune/schedulers/hb_bohb.py -> build/lib/ray/tune/schedulers
copying ray/tune/schedulers/hyperband.py -> build/lib/ray/tune/schedulers
copying ray/tune/schedulers/__init__.py -> build/lib/ray/tune/schedulers
copying ray/tune/schedulers/trial_scheduler.py -> build/lib/ray/tune/schedulers
copying ray/tune/schedulers/async_hyperband.py -> build/lib/ray/tune/schedulers
copying ray/tune/schedulers/median_stopping_rule.py -> build/lib/ray/tune/schedulers
creating build/lib/ray/tune/automlboard/frontend
copying ray/tune/automlboard/frontend/query.py -> build/lib/ray/tune/automlboard/frontend
copying ray/tune/automlboard/frontend/__init__.py -> build/lib/ray/tune/automlboard/frontend
copying ray/tune/automlboard/frontend/view.py -> build/lib/ray/tune/automlboard/frontend
copying ray/tune/automlboard/frontend/urls.py -> build/lib/ray/tune/automlboard/frontend
copying ray/tune/automlboard/frontend/wsgi.py -> build/lib/ray/tune/automlboard/frontend
creating build/lib/ray/tune/automlboard/backend
copying ray/tune/automlboard/backend/collector.py -> build/lib/ray/tune/automlboard/backend
copying ray/tune/automlboard/backend/__init__.py -> build/lib/ray/tune/automlboard/backend
creating build/lib/ray/tune/automlboard/models
copying ray/tune/automlboard/models/models.py -> build/lib/ray/tune/automlboard/models
copying ray/tune/automlboard/models/__init__.py -> build/lib/ray/tune/automlboard/models
copying ray/tune/automlboard/models/apps.py -> build/lib/ray/tune/automlboard/models
creating build/lib/ray/tune/automlboard/common
copying ray/tune/automlboard/common/exception.py -> build/lib/ray/tune/automlboard/common
copying ray/tune/automlboard/common/__init__.py -> build/lib/ray/tune/automlboard/common
copying ray/tune/automlboard/common/utils.py -> build/lib/ray/tune/automlboard/common
creating build/lib/ray/autoscaler/azure
copying ray/autoscaler/azure/config.py -> build/lib/ray/autoscaler/azure
copying ray/autoscaler/azure/__init__.py -> build/lib/ray/autoscaler/azure
copying ray/autoscaler/azure/node_provider.py -> build/lib/ray/autoscaler/azure
creating build/lib/ray/autoscaler/gcp
copying ray/autoscaler/gcp/config.py -> build/lib/ray/autoscaler/gcp
copying ray/autoscaler/gcp/__init__.py -> build/lib/ray/autoscaler/gcp
copying ray/autoscaler/gcp/node_provider.py -> build/lib/ray/autoscaler/gcp
creating build/lib/ray/autoscaler/local
copying ray/autoscaler/local/config.py -> build/lib/ray/autoscaler/local
copying ray/autoscaler/local/__init__.py -> build/lib/ray/autoscaler/local
copying ray/autoscaler/local/node_provider.py -> build/lib/ray/autoscaler/local
creating build/lib/ray/autoscaler/aws
copying ray/autoscaler/aws/config.py -> build/lib/ray/autoscaler/aws
copying ray/autoscaler/aws/__init__.py -> build/lib/ray/autoscaler/aws
copying ray/autoscaler/aws/utils.py -> build/lib/ray/autoscaler/aws
copying ray/autoscaler/aws/node_provider.py -> build/lib/ray/autoscaler/aws
creating build/lib/ray/autoscaler/kubernetes
copying ray/autoscaler/kubernetes/config.py -> build/lib/ray/autoscaler/kubernetes
copying ray/autoscaler/kubernetes/__init__.py -> build/lib/ray/autoscaler/kubernetes
copying ray/autoscaler/kubernetes/node_provider.py -> build/lib/ray/autoscaler/kubernetes
creating build/lib/ray/serve/metric
copying ray/serve/metric/exporter.py -> build/lib/ray/serve/metric
copying ray/serve/metric/client.py -> build/lib/ray/serve/metric
copying ray/serve/metric/__init__.py -> build/lib/ray/serve/metric
copying ray/serve/metric/types.py -> build/lib/ray/serve/metric
running egg_info
creating ray.egg-info
writing ray.egg-info/PKG-INFO
writing dependency_links to ray.egg-info/dependency_links.txt
writing entry points to ray.egg-info/entry_points.txt
writing requirements to ray.egg-info/requires.txt
writing top-level names to ray.egg-info/top_level.txt
writing manifest file 'ray.egg-info/SOURCES.txt'
reading manifest file 'ray.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'ray/python/ray/autoscaler/ray-schema.json'
writing manifest file 'ray.egg-info/SOURCES.txt'
running build_ext
+ set -e
+ SUPPORTED_PYTHONS=("3.5" "3.6" "3.7" "3.8")
+++ dirname ../build.sh
++ cd ..
++ pwd
+ ROOT_DIR=/ray
++ uname
+ unamestr=Linux
+ [[ Linux == \L\i\n\u\x ]]
+ PARALLEL=1
+ RAY_BUILD_PYTHON=YES
+ RAY_BUILD_JAVA=NO
+ PYTHON_EXECUTABLE=
+ BUILD_DIR=
+ [[ 2 -gt 0 ]]
+ key=-p
+ case $key in
+ PYTHON_EXECUTABLE=/opt/python/cp37-cp37m/bin/python
+ shift
+ shift
+ [[ 0 -gt 0 ]]
+ [[ -z /opt/python/cp37-cp37m/bin/python ]]
++ /opt/python/cp37-cp37m/bin/python -c 'import sys; version=sys.version_info[:3]; print("{0}.{1}".format(*version))'
+ PYTHON_VERSION=3.7
+ found=
+ for allowed in '${SUPPORTED_PYTHONS[@]}'
+ [[ 3.7 == 3.5 ]]
+ for allowed in '${SUPPORTED_PYTHONS[@]}'
+ [[ 3.7 == 3.6 ]]
+ for allowed in '${SUPPORTED_PYTHONS[@]}'
+ [[ 3.7 == 3.7 ]]
+ found=3.7
+ break
+ [[ -z 3.7 ]]
+ echo 'Using Python executable /opt/python/cp37-cp37m/bin/python.'
Using Python executable /opt/python/cp37-cp37m/bin/python.
+ '[' -z '' ']'
++ PATH=/opt/python/cp37-cp37m/bin:/root/.nvm/versions/node/v14.4.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/bin:/root/.bazel/bin
++ which bazel
+ BAZEL_EXECUTABLE=/root/bin/bazel
+ '[' -f /root/bin/bazel ']'
+ echo 'Using Bazel executable /root/bin/bazel.'
Using Bazel executable /root/bin/bazel.
+ BUILD_DIR=/ray/build/
+ '[' '!' -d /ray/build/ ']'
+ mkdir -p /ray/build/
+ pushd /ray/build/
/ray/build /ray/python
+ '[' NO == YES ']'
+ '[' YES == YES ']'
+ pickle5_available=0
+ pickle5_path=/ray/python/ray/pickle5_files
+ check_pickle5_command='import sys\nif sys.version_info < (3, 8, 2): import pickle5;'
+ PYTHONPATH=/ray/python/ray/pickle5_files:
+ /opt/python/cp37-cp37m/bin/python -s -c 'exec("import sys\nif sys.version_info < (3, 8, 2): import pickle5;")'
+ '[' 1 -ne 0 ']'
++ mktemp -d
+ TEMP_DIR=/tmp/tmp.KODh0wPvZx
+ pushd /tmp/tmp.KODh0wPvZx
/tmp/tmp.KODh0wPvZx /ray/build /ray/python
+ curl -f -s -L -R -o pickle5-backport.zip https://github.com/pitrou/pickle5-backport/archive/c0c1a158f59366696161e0dffdd10cfe17601372.zip
+ unzip -q pickle5-backport.zip
+ pushd pickle5-backport-c0c1a158f59366696161e0dffdd10cfe17601372
/tmp/tmp.KODh0wPvZx/pickle5-backport-c0c1a158f59366696161e0dffdd10cfe17601372 /tmp/tmp.KODh0wPvZx /ray/build /ray/python
+ CC=gcc
+ /opt/python/cp37-cp37m/bin/python setup.py --quiet bdist_wheel
+ unzip -q -o dist/pickle5-0.0.10-cp37-cp37m-linux_x86_64.whl -d /ray/python/ray/pickle5_files
+ popd
/tmp/tmp.KODh0wPvZx /ray/build /ray/python
+ popd
/ray/build /ray/python
+ rm -rf /tmp/tmp.KODh0wPvZx
+ '[' -z '' ']'
+ CC=gcc
+ /opt/python/cp37-cp37m/bin/python -m pip install -q psutil setproctitle --target=/ray/python/ray/thirdparty_files
You are using pip version 19.0.3, however version 20.2b1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
+ export PYTHON3_BIN_PATH=/opt/python/cp37-cp37m/bin/python
+ PYTHON3_BIN_PATH=/opt/python/cp37-cp37m/bin/python
+ /root/bin/bazel build //:ray_pkg --verbose_failures
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Writing tracer profile to '/root/.cache/bazel/_bazel_root/5fe90af4e7d1ed9fcf52f59e39e126f5/command.profile.gz'
INFO: Analyzed target //:ray_pkg (70 package
s loaded, 11190 targets configured).
INFO: Found 1 target...
INFO: From Compiling external/boost/libs/fib
er/src/numa/linux/topology.cpp:
external/boost/libs/fiber/src/numa/linux/top
ology.cpp:213:18: note: #pragma message: top
ology() not supported without <regex>
 # pragma message "topology() not supported 
without <regex>"
                  ^
INFO: From Executing genrule //:python/ray/s
treaming/_streaming.pyx_cython_translation:
warning: python/ray/streaming/includes/trans
fer.pxi:57:50: Not all members given for str
uct 'CChannelCreationParameter'
warning: python/ray/streaming/includes/trans
fer.pxi:57:50: Not all members given for str
uct 'CChannelCreationParameter'
ERROR: /ray/BUILD.bazel:622:1: C++ compilati
on of rule '//:raylet_lib' failed (Exit 4) g
cc failed: error executing command 
  (cd /root/.cache/bazel/_bazel_root/5fe90af
4e7d1ed9fcf52f59e39e126f5/sandbox/processwra
pper-sandbox/1690/execroot/com_github_ray_project_ray && \
  exec env - \
    PATH=/opt/python/cp37-cp37m/bin:/root/.nvm/versions/node/v14.4.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/bin \
    PWD=/proc/self/cwd \
  /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections -fdata-sections '-std=c++0x' -MD -MF bazel-out/k8-opt/bin/_objs/raylet_lib/node_manager.pic.d '-frandom-seed=bazel-out/k8-opt/bin/_objs/raylet_lib/node_manager.pic.o' -fPIC -DBOOST_ASIO_SEPARATE_COMPILATION -D__CLANG_SUPPORT_DYN_ANNOTATION__ -DCARES_STATICLIB -iquote . -iquote bazel-out/k8-opt/bin -iquote external/com_google_protobuf -iquote bazel-out/k8-opt/bin/external/com_google_protobuf -iquote external/zlib -iquote bazel-out/k8-opt/bin/external/zlib -iquote external/com_github_antirez_redis -iquote bazel-out/k8-opt/bin/external/com_github_antirez_redis -iquote external/com_github_google_flatbuffers -iquote bazel-out/k8-opt/bin/external/com_github_google_flatbuffers -iquote external/arrow -iquote bazel-out/k8-opt/bin/external/arrow -iquote external/boost -iquote bazel-out/k8-opt/bin/external/boost -iquote external/com_github_google_glog -iquote bazel-out/k8-opt/bin/external/com_github_google_glog -iquote external/com_github_gflags_gflags -iquote bazel-out/k8-opt/bin/external/com_github_gflags_gflags -iquote external/com_google_absl -iquote bazel-out/k8-opt/bin/external/com_google_absl -iquote external/com_google_googletest -iquote bazel-out/k8-opt/bin/external/com_google_googletest -iquote external/com_github_grpc_grpc -iquote bazel-out/k8-opt/bin/external/com_github_grpc_grpc -iquote external/upb -iquote bazel-out/k8-opt/bin/external/upb -iquote external/com_github_cares_cares -iquote bazel-out/k8-opt/bin/external/com_github_cares_cares -iquote external/boringssl -iquote bazel-out/k8-opt/bin/external/boringssl -iquote external/msgpack -iquote bazel-out/k8-opt/bin/external/msgpack -iquote external/com_github_jupp0r_prometheus_cpp -iquote bazel-out/k8-opt/bin/external/com_github_jupp0r_prometheus_cpp -iquote external/civetweb -iquote bazel-out/k8-opt/bin/external/civetweb -iquote external/com_github_madler_zlib -iquote bazel-out/k8-opt/bin/external/com_github_madler_zlib -iquote external/io_opencensus_cpp -iquote bazel-out/k8-opt/bin/external/io_opencensus_cpp -Ibazel-out/k8-opt/bin/external/com_github_antirez_redis/_virtual_includes/hiredis -Ibazel-out/k8-opt/bin/external/com_github_antirez_redis/_virtual_includes/_hiredis -Ibazel-out/k8-opt/bin/_virtual_includes/plasma_client -Ibazel-out/k8-opt/bin/external/arrow/_virtual_includes/arrow -Ibazel-out/k8-opt/bin/external/com_github_google_glog/_virtual_includes/default_glog_headers -Ibazel-out/k8-opt/bin/external/com_github_gflags_gflags/_virtual_includes/gflags -Ibazel-out/k8-opt/bin/external/msgpack/_virtual_includes/msgpack -Ibazel-out/k8-opt/bin/external/com_github_jupp0r_prometheus_cpp/pull/_virtual_includes/pull -Ibazel-out/k8-opt/bin/external/com_github_jupp0r_prometheus_cpp/core/_virtual_includes/core -isystem external/com_google_protobuf/src -isystem bazel-out/k8-opt/bin/external/com_google_protobuf/src -isystem external/zlib -isystem bazel-out/k8-opt/bin/external/zlib -isystem external/com_github_antirez_redis/deps/hiredis -isystem bazel-out/k8-opt/bin/external/com_github_antirez_redis/deps/hiredis -isystem external/com_github_google_flatbuffers/include -isystem bazel-out/k8-opt/bin/external/com_github_google_flatbuffers/include -isystem @boost/:asio -isystem bazel-out/k8-opt/bin/@boost/:asio -isystem external/boost -isystem bazel-out/k8-opt/bin/external/boost -isystem external/boost/boost/filesystem -isystem bazel-out/k8-opt/bin/external/boost/boost/filesystem -isystem external/boost/boost/config -isystem bazel-out/k8-opt/bin/external/boost/boost/config -isystem external/boost/boost/version -isystem bazel-out/k8-opt/bin/external/boost/boost/version -isystem external/boost/boost/functional -isystem bazel-out/k8-opt/bin/external/boost/boost/functional -isystem external/boost/boost/container_hash -isystem bazel-out/k8-opt/bin/external/boost/boost/container_hash -isystem external/boost/boost/assert -isystem bazel-out/k8-opt/bin/external/boost/boost/assert -isystem external/boost/boost/core -isystem bazel-out/k8-opt/bin/external/boost/boost/core -isystem external/boost/boost/integer -isystem bazel-out/k8-opt/bin/external/boost/boost/integer -isystem external/boost/boost/cstdint -isystem bazel-out/k8-opt/bin/external/boost/boost/cstdint -isystem external/boost/boost/limits -isystem bazel-out/k8-opt/bin/external/boost/boost/limits -isystem external/boost/boost/static_assert -isystem bazel-out/k8-opt/bin/external/boost/boost/static_assert -isystem external/boost/boost/type_traits -isystem bazel-out/k8-opt/bin/external/boost/boost/type_traits -isystem external/boost/boost/mpl -isystem bazel-out/k8-opt/bin/external/boost/boost/mpl -isystem external/boost/boost/move -isystem bazel-out/k8-opt/bin/external/boost/boost/move -isystem external/boost/boost/detail -isystem bazel-out/k8-opt/bin/external/boost/boost/detail -isystem external/boost/boost/preprocessor -isystem bazel-out/k8-opt/bin/external/boost/boost/preprocessor -isystem external/boost/boost/io -isystem bazel-out/k8-opt/bin/external/boost/boost/io -isystem external/boost/boost/iterator -isystem bazel-out/k8-opt/bin/external/boost/boost/iterator -isystem external/boost/boost/utility -isystem bazel-out/k8-opt/bin/external/boost/boost/utility -isystem external/boost/boost/swap -isystem bazel-out/k8-opt/bin/external/boost/boost/swap -isystem external/boost/boost/throw_exception -isystem bazel-out/k8-opt/bin/external/boost/boost/throw_exception -isystem external/boost/boost/current_function -isystem bazel-out/k8-opt/bin/external/boost/boost/current_function -isystem external/boost/boost/exception -isystem bazel-out/k8-opt/bin/external/boost/boost/exception -isystem external/boost/boost/range -isystem bazel-out/k8-opt/bin/external/boost/boost/range -isystem external/boost/boost/array -isystem bazel-out/k8-opt/bin/external/boost/boost/array -isystem external/boost/boost/concept_check -isystem bazel-out/k8-opt/bin/external/boost/boost/concept_check -isystem external/boost/boost/concept -isystem bazel-out/k8-opt/bin/external/boost/boost/concept -isystem external/boost/boost/concept_archetype -isystem bazel-out/k8-opt/bin/external/boost/boost/concept_archetype -isystem external/boost/boost/noncopyable -isystem bazel-out/k8-opt/bin/external/boost/boost/noncopyable -isystem external/boost/boost/optional -isystem bazel-out/k8-opt/bin/external/boost/boost/optional -isystem external/boost/boost/none -isystem bazel-out/k8-opt/bin/external/boost/boost/none -isystem external/boost/boost/type -isystem bazel-out/k8-opt/bin/external/boost/boost/type -isystem external/boost/boost/ref -isystem bazel-out/k8-opt/bin/external/boost/boost/ref -isystem external/boost/boost/regex -isystem bazel-out/k8-opt/bin/external/boost/boost/regex -isystem external/boost/boost/predef -isystem bazel-out/k8-opt/bin/external/boost/boost/predef -isystem external/boost/boost/smart_ptr -isystem bazel-out/k8-opt/bin/external/boost/boost/smart_ptr -isystem external/boost/boost/align -isystem bazel-out/k8-opt/bin/external/boost/boost/align -isystem external/boost/boost/scoped_array -isystem bazel-out/k8-opt/bin/external/boost/boost/scoped_array -isystem external/boost/boost/checked_delete -isystem bazel-out/k8-opt/bin/external/boost/boost/checked_delete -isystem external/boost/boost/scoped_ptr -isystem bazel-out/k8-opt/bin/external/boost/boost/scoped_ptr -isystem external/boost/boost/shared_array -isystem bazel-out/k8-opt/bin/external/boost/boost/shared_array -isystem external/boost/boost/shared_ptr -isystem bazel-out/k8-opt/bin/external/boost/boost/shared_ptr -isystem external/boost/boost/tuple -isystem bazel-out/k8-opt/bin/external/boost/boost/tuple -isystem external/boost/boost/system -isystem bazel-out/k8-opt/bin/external/boost/boost/system -isystem external/boost/boost/cerrno -isystem bazel-out/k8-opt/bin/external/boost/boost/cerrno -isystem src -isystem bazel-out/k8-opt/bin/src -isystem src/ray/thirdparty -isystem bazel-out/k8-opt/bin/src/ray/thirdparty -isystem external/boost/boost/asio -isystem bazel-out/k8-opt/bin/external/boost/boost/asio -isystem external/boost/boost/bind -isystem bazel-out/k8-opt/bin/external/boost/boost/bind -isystem external/boost/boost/get_pointer -isystem bazel-out/k8-opt/bin/external/boost/boost/get_pointer -isystem external/boost/boost/is_placeholder -isystem bazel-out/k8-opt/bin/external/boost/boost/is_placeholder -isystem external/boost/boost/mem_fn -isystem bazel-out/k8-opt/bin/external/boost/boost/mem_fn -isystem external/boost/boost/visit_each -isystem bazel-out/k8-opt/bin/external/boost/boost/visit_each -isystem external/boost/boost/date_time -isystem bazel-out/k8-opt/bin/external/boost/boost/date_time -isystem external/boost/boost/algorithm -isystem bazel-out/k8-opt/bin/external/boost/boost/algorithm -isystem external/boost/boost/function -isystem bazel-out/k8-opt/bin/external/boost/boost/function -isystem external/boost/boost/type_index -isystem bazel-out/k8-opt/bin/external/boost/boost/type_index -isystem external/boost/boost/lexical_cast -isystem bazel-out/k8-opt/bin/external/boost/boost/lexical_cast -isystem external/boost/boost/chrono -isystem bazel-out/k8-opt/bin/external/boost/boost/chrono -isystem external/boost/boost/operators -isystem bazel-out/k8-opt/bin/external/boost/boost/operators -isystem external/boost/boost/ratio -isystem bazel-out/k8-opt/bin/external/boost/boost/ratio -isystem external/boost/boost/container -isystem bazel-out/k8-opt/bin/external/boost/boost/container -isystem external/boost/boost/intrusive -isystem bazel-out/k8-opt/bin/external/boost/boost/intrusive -isystem external/boost/boost/math -isystem bazel-out/k8-opt/bin/external/boost/boost/math -isystem external/boost/boost/atomic -isystem bazel-out/k8-opt/bin/external/boost/boost/atomic -isystem external/boost/boost/fusion -isystem bazel-out/k8-opt/bin/external/boost/boost/fusion -isystem external/boost/boost/call_traits -isystem bazel-out/k8-opt/bin/external/boost/boost/call_traits -isystem external/boost/boost/function_types -isystem bazel-out/k8-opt/bin/external/boost/boost/function_types -isystem external/boost/boost/typeof -isystem bazel-out/k8-opt/bin/external/boost/boost/typeof -isystem external/boost/boost/lambda -isystem bazel-out/k8-opt/bin/external/boost/boost/lambda -isystem external/boost/boost/mp11 -isystem bazel-out/k8-opt/bin/external/boost/boost/mp11 -isystem external/boost/boost/numeric_conversion -isystem bazel-out/k8-opt/bin/external/boost/boost/numeric_conversion -isystem external/boost/boost/tokenizer -isystem bazel-out/k8-opt/bin/external/boost/boost/tokenizer -isystem external/com_google_googletest/googlemock -isystem bazel-out/k8-opt/bin/external/com_google_googletest/googlemock -isystem external/com_google_googletest/googlemock/include -isystem bazel-out/k8-opt/bin/external/com_google_googletest/googlemock/include -isystem external/com_google_googletest/googletest -isystem bazel-out/k8-opt/bin/external/com_google_googletest/googletest -isystem external/com_google_googletest/googletest/include -isystem bazel-out/k8-opt/bin/external/com_google_googletest/googletest/include -isystem external/com_github_grpc_grpc/include -isystem bazel-out/k8-opt/bin/external/com_github_grpc_grpc/include -isystem external/com_github_grpc_grpc/src/core/ext/upb-generated -isystem bazel-out/k8-opt/bin/external/com_github_grpc_grpc/src/core/ext/upb-generated -isystem external/com_github_cares_cares -isystem bazel-out/k8-opt/bin/external/com_github_cares_cares -isystem external/com_github_grpc_grpc/third_party/address_sorting/include -isystem bazel-out/k8-opt/bin/external/com_github_grpc_grpc/third_party/address_sorting/include -isystem external/boringssl/src/include -isystem bazel-out/k8-opt/bin/external/boringssl/src/include -isystem external/msgpack/include -isystem bazel-out/k8-opt/bin/external/msgpack/include -isystem external/civetweb/include -isystem bazel-out/k8-opt/bin/external/civetweb/include -isystem external/com_github_madler_zlib -isystem bazel-out/k8-opt/bin/external/com_github_madler_zlib -isystem external/boost/boost/thread -isystem bazel-out/k8-opt/bin/external/boost/boost/thread -isystem external/boost/boost/enable_shared_from_this -isystem bazel-out/k8-opt/bin/external/boost/boost/enable_shared_from_this -DRAY_USE_GLOG -Werror -fno-canonical-system-headers -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c src/ray/raylet/node_manager.cc -o bazel-out/k8-opt/bin/_objs/raylet_lib/node_manager.pic.o)
Execution platform: @local_config_platform//:host

Use --sandbox_debug to see verbose messages from the sandbox
gcc: internal compiler error: Killed (progra
m cc1plus)
Please submit a full bug report,
with preprocessed source if appropriate.
See <file:///usr/share/doc/gcc-4.8/README.Bugs> for instructions.
Target //:ray_pkg failed to build
INFO: Elapsed time: 640.238s, Critical Path:
 181.36s
INFO: 1689 processes: 1 local, 1688 processw
rapper-sandbox.
FAILED: Build did NOT complete successfull\
y
Traceback (most recent call last):
  File "setup.py", line 231, in <module>
    license="Apache 2.0")
  File "/opt/python/cp37-cp37m/lib/python3.7/site-packages/setuptools/__init__.py", line 145, in setup
    return distutils.core.setup(**attrs)
  File "/opt/python/cp37-cp37m/lib/python3.7/distutils/core.py", line 148, in setup
    dist.run_commands()
  File "/opt/python/cp37-cp37m/lib/python3.7/distutils/dist.py", line 966, in run_commands
    self.run_command(cmd)
  File "/opt/python/cp37-cp37m/lib/python3.7/distutils/dist.py", line 985, in run_command
    cmd_obj.run()
  File "/opt/python/cp37-cp37m/lib/python3.7/site-packages/wheel/bdist_wheel.py", line 202, in run
    self.run_command('build')
  File "/opt/python/cp37-cp37m/lib/python3.7/distutils/cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "/opt/python/cp37-cp37m/lib/python3.7/distutils/dist.py", line 985, in run_command
    cmd_obj.run()
  File "/opt/python/cp37-cp37m/lib/python3.7/distutils/command/build.py", line 135, in run
    self.run_command(cmd_name)
  File "/opt/python/cp37-cp37m/lib/python3.7/distutils/cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "/opt/python/cp37-cp37m/lib/python3.7/distutils/dist.py", line 985, in run_command
    cmd_obj.run()
  File "setup.py", line 121, in run
    subprocess.check_call(command)
  File "/opt/python/cp37-cp37m/lib/python3.7/subprocess.py", line 347, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['../build.sh', '-p', '/opt/python/cp37-cp37m/bin/python']' returned non-zero exit status 1.
richardliaw commented 4 years ago

bump @gramhagen or @eisber ?

gramhagen commented 4 years ago

@AndreCNF not sure why that build failed?

But I found some time and added a PR (#8938) to address this. There's a wheel built for python3.7 here: https://sdgraystorage.blob.core.windows.net/ray-wheels/ray-0.9.0.dev0-cp37-cp37m-manylinux1_x86_64.whl

Just install that and grab changes in the new example-full.yaml

AndreCNF commented 4 years ago

Everything is working perfectly well now after @gramhagen's PR #8938! Thank you all for fixing this and helping me!