ROCm / rocmProfileData

MIT License
12 stars 5 forks source link

[Issue]: Installation failed with `EasyInstallDeprecationWarning` #57

Open danpetreamd opened 3 weeks ago

danpetreamd commented 3 weeks ago

Problem Description

This is the message I get after make install: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.

More details below:

$ apt-get update; apt-get install sqlite3 libsqlite3-dev libfmt-dev
$ cd rocmProfileData
$ make -j
$ make install

Operating System

OS: NAME="Ubuntu" VERSION="20.04.6 LTS (Focal Fossa)"

CPU

CPU: model name : AMD EPYC 7V12 64-Core Processor

GPU

AMD Instinct MI300X, AMD Instinct MI250

ROCm Version

ROCm 6.1.0

ROCm Component

No response

Steps to Reproduce

$ git clone --recursive git@github.com:ROCm/DeepLearningModels.git
$ git clone --recursive git@github.com:ROCm/rocmProfileData.git

$ cd DeepLearningModels
$ python3 ./tools/run_models.py --tags pyt_superbench_e2e_cnn_bz32 --additionalContext "{'guest_os':'UBUNTU' }" --skipModelRun  --liveOutput --keepAlive
$ docker container exec -it container_pyt_superbench_e2e_cnn_bz32_pyt_superbench_vision.ubuntu.amd bash

# inside the container
$ apt-get update; apt-get install sqlite3 libsqlite3-dev libfmt-dev
$ cd rocmProfileData
$ make -j
$ make install

make install -C rocpd_python
make[1]: Entering directory '/myworkspace/superbenchmark/rocmProfileData/rocpd_python'
Building rocpd_python
pip install --user .
Processing /myworkspace/superbenchmark/rocmProfileData/rocpd_python
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: rocpd
  Building wheel for rocpd (setup.py) ... done
  Created wheel for rocpd: filename=rocpd-1.0-py3-none-any.whl size=26510 sha256=c1c0c3be5b866295add7fb14676cd3321dd3badc993b90b981beedc835943759
  Stored in directory: /tmp/pip-ephem-wheel-cache-6fc07xek/wheels/83/41/7c/8fc406e541bb5ffa034cbb545fa9d8430c22f18c58e98d72eb
Successfully built rocpd
DEPRECATION: omegaconf 2.0.6 has a non-standard dependency specifier PyYAML>=5.1.*. pip 24.1 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of omegaconf or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at https://github.com/pypa/pip/issues/12063
Installing collected packages: rocpd
Successfully installed rocpd-1.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
make[1]: Leaving directory '/myworkspace/superbenchmark/rocmProfileData/rocpd_python'
make install -C rpd_tracer
make[1]: Entering directory '/myworkspace/superbenchmark/rocmProfileData/rpd_tracer'
Building with roctracer
cp librpd_tracer.so  /usr/local/lib/
cp runTracer.sh loadTracer.sh /usr/local/bin/
ldconfig
python3 setup.py install
/opt/conda/envs/py_3.9/lib/python3.9/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
/opt/conda/envs/py_3.9/lib/python3.9/site-packages/setuptools/command/easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
zip_safe flag not set; analyzing archive contents...
make[1]: Leaving directory '/myworkspace/superbenchmark/rocmProfileData/rpd_tracer'

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

There was an error creating your Issue: body is too long (maximum is 65536 characters).

/opt/rocm/bin/rocminfo --support ROCk module version 6.7.0 is loaded

HSA System Attributes

Runtime Version: 1.13 Runtime Ext Version: 1.4 System Timestamp Freq.: 1000.000000MHz Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) Machine Model: LARGE System Endianness: LITTLE Mwaitx: DISABLED DMAbuf Support: YES

========== HSA Agents


Agent 1


Name: AMD EPYC 7V12 64-Core Processor Uuid: CPU-XX Marketing Name: AMD EPYC 7V12 64-Core Processor Vendor Name: CPU Feature: None specified Profile: FULL_PROFILE Float Round Mode: NEAR Max Queue Number: 0(0x0) Queue Min Size: 0(0x0) Queue Max Size: 0(0x0) Queue Type: MULTI Node: 0 Device Type: CPU Cache Info: L1: 32768(0x8000) KB Chip ID: 0(0x0) ASIC Revision: 0(0x0) Cacheline Size: 64(0x40) Max Clock Freq. (MHz): 2450 BDFID: 0 Internal Node ID: 0 Compute Unit: 64 SIMDs per CU: 0 Shader Engines: 0 Shader Arrs. per Eng.: 0 WatchPts on Addr. Ranges:1 Features: None Pool Info: Pool 1 Segment: GLOBAL; FLAGS: FINE GRAINED Size: 528267308(0x1f7cb82c) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Recommended Granule:4KB Alloc Alignment: 4KB Accessible by all: TRUE Pool 2 Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED Size: 528267308(0x1f7cb82c) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Recommended Granule:4KB Alloc Alignment: 4KB Accessible by all: TRUE Pool 3 Segment: GLOBAL; FLAGS: COARSE GRAINED Size: 528267308(0x1f7cb82c) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Recommended Granule:4KB Alloc Alignment: 4KB Accessible by all: TRUE ISA Info:


Agent 2


Name: AMD EPYC 7V12 64-Core Processor Uuid: CPU-XX Marketing Name: AMD EPYC 7V12 64-Core Processor Vendor Name: CPU Feature: None specified Profile: FULL_PROFILE Float Round Mode: NEAR Max Queue Number: 0(0x0) Queue Min Size: 0(0x0) Queue Max Size: 0(0x0) Queue Type: MULTI Node: 1 Device Type: CPU Cache Info: L1: 32768(0x8000) KB Chip ID: 0(0x0) ASIC Revision: 0(0x0) Cacheline Size: 64(0x40) Max Clock Freq. (MHz): 2450 BDFID: 0 Internal Node ID: 1 Compute Unit: 64 SIMDs per CU: 0 Shader Engines: 0 Shader Arrs. per Eng.: 0 WatchPts on Addr. Ranges:1 Features: None Pool Info: Pool 1 Segment: GLOBAL; FLAGS: FINE GRAINED Size: 528451864(0x1f7f8918) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Recommended Granule:4KB Alloc Alignment: 4KB Accessible by all: TRUE Pool 2 Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED Size: 528451864(0x1f7f8918) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Recommended Granule:4KB Alloc Alignment: 4KB Accessible by all: TRUE Pool 3 Segment: GLOBAL; FLAGS: COARSE GRAINED Size: 528451864(0x1f7f8918) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Recommended Granule:4KB Alloc Alignment: 4KB Accessible by all: TRUE ISA Info:


Agent 3


[The rest was omitted due to character limit]. Done

Additional Information

No response

danpetreamd commented 3 weeks ago

I needed to use runTracer.sh and noticed that runTracer.sh fails to run. I do get the following hint: Please run 'python setup.py install' from the rocpd_python dir. If I do that than the runTracer.sh works and this also fixes the rest of the rpd installation.

rocmProfileData $ which runTracer.sh
/usr/local/bin/runTracer.sh

rocmProfileData $ runTracer.sh
/opt/conda/envs/py_3.9/bin/python3: No module named rocpd.schema
Error: Could not create rpd file. Please run 'python setup.py install' from the rocpd_python dir

rocmProfileData $ cd rocpd_python/
rocmProfileData/rocpd_python# python3 -m pip install .
Processing /myworkspace/superbenchmark/rocmProfileData/rocpd_python
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: rocpd
  Building wheel for rocpd (setup.py) ... done
  Created wheel for rocpd: filename=rocpd-1.0-py3-none-any.whl size=26510 sha256=b2ae827c0e1e43fc4d446344f0a66ae91025c514097c39cde121247c3257114f
  Stored in directory: /tmp/pip-ephem-wheel-cache-yjonogvg/wheels/83/41/7c/8fc406e541bb5ffa034cbb545fa9d8430c22f18c58e98d72eb
Successfully built rocpd
DEPRECATION: omegaconf 2.0.6 has a non-standard dependency specifier PyYAML>=5.1.*. pip 24.1 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of omegaconf or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at https://github.com/pypa/pip/issues/12063
Installing collected packages: rocpd
  Attempting uninstall: rocpd
    Found existing installation: rocpd 1.0
    Uninstalling rocpd-1.0:
      Successfully uninstalled rocpd-1.0
Successfully installed rocpd-1.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

rocmProfileData/rocpd_python# runTracer.sh
Creating empty rpd: trace.rpd