Could not install packages cm with using python 3.8

[ByoungjunSeo]

[mlcommons@localhost submissions_inference_v3.1]$ python3.8 -m pip install cmind
Collecting cmind
  Downloading https://files.pythonhosted.org/packages/43/d0/2ed3f801449a069ec381a89e72a71c400ec66939333db89b0a3b4cda2f31/cmind-1.5.1.tar.gz (48kB)
     |████████████████████████████████| 51kB 3.4MB/s
Collecting pyyaml
  Downloading https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736kB)
     |████████████████████████████████| 737kB 15.3MB/s
Collecting requests
  Downloading https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl (62kB)
     |████████████████████████████████| 71kB 7.0MB/s
Collecting certifi>=2017.4.17
  Using cached https://files.pythonhosted.org/packages/4c/dd/2234eab22353ffc7d94e8d13177aaa050113286e93e7b40eae01fbf7c3d9/certifi-2023.7.22-py3-none-any.whl
Collecting urllib3<3,>=1.21.1
  Downloading https://files.pythonhosted.org/packages/9b/81/62fd61001fa4b9d0df6e31d47ff49cfa9de4af03adecf339c7bc30656b37/urllib3-2.0.4-py3-none-any.whl (123kB)
     |████████████████████████████████| 133kB 97.1MB/s
Collecting idna<4,>=2.5
  Downloading https://files.pythonhosted.org/packages/fc/34/3030de6f1370931b9dbb4dad48f6ab1015ab1d32447850b9fc94e60097be/idna-3.4-py3-none-any.whl (61kB)
     |████████████████████████████████| 71kB 21.6MB/s
Collecting charset-normalizer<4,>=2
  Downloading https://files.pythonhosted.org/packages/cb/e7/5e43745003bf1f90668c7be23fc5952b3a2b9c2558f16749411c18039b36/charset_normalizer-3.2.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199kB)
     |████████████████████████████████| 204kB 99.7MB/s
Installing collected packages: pyyaml, certifi, urllib3, idna, charset-normalizer, requests, cmind
ERROR: Could not install packages due to an EnvironmentError: [Errno 13] 허가 거부: '/usr/local/lib64/python3.8'
Consider using the `--user` option or check the permissions.

[mlcommons@localhost submissions_inference_v3.1]$ python3.8 -m pip install cmind --user
Collecting cmind
  Using cached https://files.pythonhosted.org/packages/43/d0/2ed3f801449a069ec381a89e72a71c400ec66939333db89b0a3b4cda2f31/cmind-1.5.1.tar.gz
Collecting pyyaml
  Using cached https://files.pythonhosted.org/packages/c8/6b/6600ac24725c7388255b2f5add93f91e58a5d7efaf4af244fdbcc11a541b/PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Collecting requests
  Using cached https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl
Collecting charset-normalizer<4,>=2
  Using cached https://files.pythonhosted.org/packages/cb/e7/5e43745003bf1f90668c7be23fc5952b3a2b9c2558f16749411c18039b36/charset_normalizer-3.2.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Collecting urllib3<3,>=1.21.1
  Using cached https://files.pythonhosted.org/packages/9b/81/62fd61001fa4b9d0df6e31d47ff49cfa9de4af03adecf339c7bc30656b37/urllib3-2.0.4-py3-none-any.whl
Collecting certifi>=2017.4.17
  Using cached https://files.pythonhosted.org/packages/4c/dd/2234eab22353ffc7d94e8d13177aaa050113286e93e7b40eae01fbf7c3d9/certifi-2023.7.22-py3-none-any.whl
Collecting idna<4,>=2.5
  Using cached https://files.pythonhosted.org/packages/fc/34/3030de6f1370931b9dbb4dad48f6ab1015ab1d32447850b9fc94e60097be/idna-3.4-py3-none-any.whl
Installing collected packages: pyyaml, charset-normalizer, urllib3, certifi, idna, requests, cmind
    Running setup.py install for cmind ... done
Successfully installed certifi-2023.7.22 charset-normalizer-3.2.0 cmind-1.5.1 idna-3.4 pyyaml-6.0.1 requests-2.31.0 urllib3-2.0.4
[mlcommons@localhost submissions_inference_v3.1]$ cm run script --tags=run,submission,checker --input=/scratch/submissions_inference_v3.1/scratch/submissions_inference_v3.1 --submitter=TTA --env.INFER_SYSTEM_FILE=yes --extra_args=' --skip-extra-files-in-root-check=yes'
* cm run script "run submission checker"
  * cm run script "get python3"
  * cm run script "get mlcommons inference src"
  * cm run script "get generic-python-lib _xlsxwriter"
    * cm run script "detect os"
    * cm run script "detect cpu"
      * cm run script "detect os"
    * cm run script "get python3"
    * cm run script "get generic-python-lib _pip"
      * cm run script "detect os"
      * cm run script "detect cpu"
        * cm run script "detect os"
      * cm run script "get python3"
/usr/bin/python3.8 /mlcommons_cm/cm/repos/mlcommons@ck/cm-mlops/script/get-generic-python-lib/detect-version.py > tmp-ver.out 2> tmp-ver.err
          Detected version: 19.3.1
/usr/bin/python3.8 /mlcommons_cm/cm/repos/mlcommons@ck/cm-mlops/script/get-generic-python-lib/detect-version.py > tmp-ver.out 2> tmp-ver.err
/usr/bin/python3.8 /mlcommons_cm/cm/repos/mlcommons@ck/cm-mlops/script/get-generic-python-lib/detect-version.py > tmp-ver.out 2> tmp-ver.err
/usr/bin/python3.8 -m pip install "xlsxwriter"
Collecting xlsxwriter
  Using cached https://files.pythonhosted.org/packages/37/94/25d3ec8587974de7ebd790232aa3155abfe44ed23df7ccaa4645977a1cbe/XlsxWriter-3.1.2-py3-none-any.whl
Installing collected packages: xlsxwriter
ERROR: Could not install packages due to an EnvironmentError: [Errno 13] 허가 거부: '/usr/local/lib64/python3.8'
Consider using the `--user` option or check the permissions.

CM error: Portable CM script failed (name = get-generic-python-lib, return code = 256)

Note that it is often a portability problem of the third-party tool or native script that is wrapped and unified by this CM script.
The CM concept is to collaboratively fix such issues inside portable CM scripts to make existing tools and native script more portable, interoperable, deterministic and reproducible.

Please help the community by reporting the full log with the command line here:
* https://github.com/mlcommons/ck/issues
* https://cKnowledge.org/mlcommons-taskforce

Thank you!

[gfursin]

@arjunsuresh - it works on my machine. But I have a feeling is that an extra deps (xlsxwriter) that was added recently and may not always work. Any idea what may happen here? Can you reproduce/check this issue, please? Thanks a lot!

[arjunsuresh]

Hi @gfursin it is due to --user not added to pip install on CentOS I believe. I think we should discuss this.

[gfursin]

@arjunsuresh - do you know if this has been fixed?

[gfursin]

We did many updates to CM automations to fix this issue - is it possible to recheck all that?

[gfursin]

I believe these issues are fixed now. I close this ticket and we can reopen it if the problem reappears.