AMD install out of date?

jthree2001 commented 1 year ago

I was running through the amd install instructions and the folder repos/gptq is missing and setup_cuda.py is also missing.

Are the AMD install instructions out of date?

0cc4m commented 1 year ago

Yes, they are. It was replaced with a Python wheel as well, but issues have been reported with it. I'll try to update them soon.

keyxmakerx commented 1 year ago

+1 :)

celisum commented 1 year ago

+1

0cc4m commented 1 year ago

I updated them, please check if you can follow them and if it works.

keyxmakerx commented 1 year ago

Got the following errors on the pip install

      Warning: The --amdgpu-target option has been deprecated and will be removed in the future.  Use --offload-arch instead.
      In file included from <built-in>:1:
      /opt/rocm-5.4.5/llvm/lib/clang/15.0.0/include/__clang_hip_runtime_wrapper.h:50:10: fatal error: 'cmath' file not found
      #include <cmath>
               ^~~~~~~
      1 error generated when compiling for gfx1030.

      RuntimeError: Error compiling objects for extension
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for gptq-koboldai
  Running setup.py clean for gptq-koboldai
Failed to build gptq-koboldai
ERROR: Could not build wheels for gptq-koboldai, which is required to install pyproject.toml-based projects

0cc4m commented 1 year ago

That means you are missing some system headers. Check your distro for the right package. It could be libstdc++-12-dev for Ubuntu, for example.

0cc4m / KoboldAI

AMD install out of date? #29