llama-cpp-python

[laraPPr]

• link to support ticket: #2023112360001315
• website: https://github.com/abetlen/llama-cpp-python
• installation docs: https://github.com/abetlen/llama-cpp-python?tab=readme-ov-file#installation
• toolchain: ? (Toolchain needs to have pytorch build
• easyblock to use: CMake?
• required dependencies:
  • [ ] OpenBlas
  • [ ] cuBLAS
  • [ ] Metal
  • [ ] CLBlast
  • [ ] hipBLAS
• optional dependencies:
  • [ ] ...
• notes:
• effort: (TBD)
• other install methods
  • conda: no
  • container image: no
  • pre-built binaries (RHEL8 Linux x86_64): / no
  • easyconfig outside EasyBuild: / no