Closed Foddy closed 3 months ago
To pass a Huggingface access token in the Docker container, you can set the HF_TOKEN
environment variable. Modify the Docker run command to include the token as follows:
port=7997
model1=nvidia/NV-Embed-v1
volume=$PWD/data
# Set your Huggingface token
HF_TOKEN=your_huggingface_token_here
docker run -it --gpus all \
-v $volume:/app/.cache \
-p $port:$port \
-e HF_TOKEN=$HF_TOKEN \
michaelf34/infinity:latest \
v2 \
--model-id $model1 \
--port $port
Ensure that the HF_TOKEN
environment variable is set correctly in your Dockerfile or Docker run command.
Is there a way to pass an access token from Huggingface in the Docker container? I would like to try the model
nvidia/NV-Embed-v1
, which unfortunately is restricted.