go-skynet / go-llama.cpp

LLama.cpp golang bindings
MIT License
626 stars 78 forks source link

Enable build for ROCm/HIPBLAS #235

Closed 65a closed 9 months ago

65a commented 9 months ago

Adds HIPBLAS build type for binding.a which leverages extant upstream ROCm/HIPBLAS support. Tested on gfx1100, but should work for gfx900, gfx1030, gfx1031 and gfx1100 by default. Setting AMDGPU_TARGETS or GPU_TARGETS allows changing this at build time, these are just sensible defaults.

65a commented 9 months ago

Tested on gfx1030 as well