search

akash-network / awesome-akash

Awesome List of Akash Deployment Examples
298 stars 217 forks source link

Falcon-7B: bump torch, xformers to support sm_90 capability (for H100) #529

Closed andy108369 closed 1 month ago

andy108369 commented 1 month ago

DO NOT merge yet

WIP: testing this version now

 # Install necessary packages
-RUN apt update && apt install -y \
+RUN apt update && apt install -y --no-install-recommends \
     python3 \
     python3-pip \
-    python3-venv \
-    build-essential \
-    cmake \
-    libopenblas-dev \
-    libomp-dev
+    python3-venv
andy108369 commented 1 month ago

Successfully tested on the H100 provider (with the newest nvidia drivers v555 with cuda support up to 12.5)! image