search

huggingface / text-embeddings-inference

A blazing fast inference solution for text embeddings models
https://huggingface.co/docs/text-embeddings-inference/quick_tour
Apache License 2.0
2.81k stars 176 forks source link

unknown flag: --gpus See 'docker run --help' #397

Open sswolf opened 2 months ago

sswolf commented 2 months ago

System Info

docker info

docker info Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 10 Server Version: 27.2.0 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: systemd Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 nvidia Default Runtime: nvidia Init Binary: docker-init containerd version: 0cae528dd6cb557f7201036e9f43420650207b58 runc version: v1.1.7-0-g860f061b init version: de40ad0 Security Options: apparmor seccomp WARNING: You're not using the default seccomp profile Profile: builtin Kernel Version: 4.4.0-210-generic Operating System: Ubuntu 16.04.7 LTS OSType: linux Architecture: x86_64 CPUs: 8 Total Memory: 31.33GiB Name: sc-gpu-server-02 ID: 16e0dba0-6073-40e1-b486-f6b8247d5866 Docker Root Dir: /var/lib/docker Debug Mode (client): false Debug Mode (server): false Registry: https://index.docker.io/v1/ Labels: Experimental: false Insecure Registries: 127.0.0.0/8 Registry Mirrors: https://82m9ar63.mirror.aliyuncs.com/ https://kfwkfulq.mirror.aliyuncs.com/ https://2lqq34jg.mirror.aliyuncs.com/ https://pee6w651.mirror.aliyuncs.com/ http://hub-mirror.c.163.com/ https://docker.mirrors.ustc.edu.cn/ https://registry.docker-cn.com/ Live Restore Enabled: false Product License: Community Engine

WARNING: No swap limit support

System version： cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=16.04 DISTRIB_CODENAME=xenial DISTRIB_DESCRIPTION="Ubuntu 16.04.7 LTS"

CMD: model=BAAI/bge-reranker-v2-m3 volume=$PWD/data docker run --gpus all -p 8080:80 -v $volume:/data --pull always ghcr.io/huggingface/text-embeddings-inference:1.5 --model-id $model

lQLPJw9CINgT_I_NA_DNBIKwXjAY7IptIxAGwHEdHPxHAA_1154_1008 lQLPJwIc_3ZovI_Mws0JyLAZ2aNrOzsqqwbAcR0c_EcC_2504_194

Information

Tasks

Reproduction

1.install docker 27.2 2.docker run cmd

Expected behavior

The docker container is running properly

huyhandes commented 1 month ago

Check is the nvidia-docker2 is installed or not. Follow this guide to install: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html