mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.37k stars 817 forks source link

Cannot download latest image #117

Open louispaulet opened 6 months ago

louispaulet commented 6 months ago

I have an issue running this command:

docker pull ghcr.io/mistralai/mistral-src/vllm:latest

Here is the output:

$ docker pull ghcr.io/mistralai/mistral-src/vllm:latest
latest: Pulling from mistralai/mistral-src/vllm
43f89b94cd7d: Already exists
45f7ea5367fe: Already exists
3d97a47c3c73: Already exists
12cd4d19752f: Already exists
da5a484f9d74: Already exists
5e5846364eee: Already exists
fd355de1d1f2: Already exists
3480bb79c638: Already exists
e7016935dd60: Already exists
99541166a133: Already exists
8999112df5b0: Already exists
e969c5eb17ee: Pulling fs layer
174617b6ae76: Pulling fs layer
7fcb0eeb3246: Pulling fs layer
8546325b89a2: Pulling fs layer
fd3e44b6510f: Pulling fs layer
1ad8795b31a4: Pulling fs layer
962181193532: Pulling fs layer
ccb00ad5abb9: Pulling fs layer
fa4989232485: Pulling fs layer
fd3e44b6510f: Waiting
1ad8795b31a4: Waiting
962181193532: Waiting
ccb00ad5abb9: Waiting
fa4989232485: Waiting
8546325b89a2: Waiting
e969c5eb17ee: Verifying Checksum
e969c5eb17ee: Pull complete
8546325b89a2: Download complete
174617b6ae76: Verifying Checksum
174617b6ae76: Download complete
1ad8795b31a4: Download complete
174617b6ae76: Pull complete
962181193532: Verifying Checksum
962181193532: Download complete
ccb00ad5abb9: Verifying Checksum
ccb00ad5abb9: Download complete
fa4989232485: Verifying Checksum
fa4989232485: Download complete
fd3e44b6510f: Verifying Checksum
fd3e44b6510f: Download complete

It then hangs at the last step, with outputs like "retrying in 5 seconds", "retrying in 10 seconds", etc.

Anybody else is having this issue?

I have no issue pulling the previous image tho:

docker pull ghcr.io/mistralai/mistral-src/vllm:288c7c

This command does work perfectly.

louispaulet commented 6 months ago

Anybody experiencing the same issues?

louispaulet commented 6 months ago

I'll start building the image from dockerfile in the meantime...