search

gliderlabs / docker-alpine

Alpine Linux Docker image. Win at minimalism!
http://gliderlabs.viewdocs.io/docker-alpine
BSD 2-Clause "Simplified" License
5.7k stars 528 forks source link

Repository problem? #279

Closed Skorpyon closed 7 years ago

Skorpyon commented 7 years ago

http://dl-cdn.alpinelinux.org/alpine/v3.4/main/x86_64/APKINDEX.tar.gz

Error 503 Connection timed out Connection timed out Guru Mediation: Details: cache-hhn1533-HHN 1494522331 3223824506 Varnish cache server

JWinkler05 commented 7 years ago

I am getting the same thing.

Also, to note. This is happening on more than just v3.4. I tried on 3.5 and 3.3 and there was a 503 response from each.

pkhxcp commented 7 years ago

Also having this issue

QSonx commented 7 years ago

Also having this problem. Right when I was tweaking my ci pipeline.

borourke commented 7 years ago

+1 on having this issue

fetch http://dl-cdn.alpinelinux.org/alpine/v3.4/main/x86_64/APKINDEX.tar.gz
ERROR: http://dl-cdn.alpinelinux.org/alpine/v3.4/main: temporary error (try again later)
Zebradil commented 7 years ago

Use one of the mirrors:

http://dl-cdn.alpinelinux.org/alpine/
http://nl.alpinelinux.org/alpine/
http://dl-2.alpinelinux.org/alpine/
http://dl-3.alpinelinux.org/alpine/
http://dl-4.alpinelinux.org/alpine/
http://dl-5.alpinelinux.org/alpine/
http://dl-6.alpinelinux.org/alpine/
http://dl-8.alpinelinux.org/alpine/
http://distrib-coffee.ipsl.jussieu.fr/pub/linux/alpine/alpine/
http://mirror.yandex.ru/mirrors/alpine/
http://mirrors.gigenet.com/alpinelinux/
http://repos.lax-noc.com/alpine/
http://repos.dfw.lax-noc.com/alpine/
http://repos.mia.lax-noc.com/alpine/
http://mirror1.hs-esslingen.de/pub/Mirrors/alpine/
http://liskamm.alpinelinux.uk/
http://mirrors.2f30.org/alpine/
http://mirror.leaseweb.com/alpine/
http://repository.fit.cvut.cz/mirrors/alpine/
http://alpine.mirror.far.fi/
http://lasca.ic.unicamp.br/pub/alpine/
http://alpinelinux.c3sl.ufpr.br/

I mean, you could modify your Dockerfile with something like this:

RUN echo http://mirror.yandex.ru/mirrors/alpine/v3.5/main > /etc/apk/repositories; \
    echo http://mirror.yandex.ru/mirrors/alpine/v3.5/community >> /etc/apk/repositories

RUN apk update \
 && apk add --no-cache \
...
mattatcha commented 7 years ago

@andyshinn and I are looking into this.

mbelang commented 7 years ago

Getting the same issue here as well.

@Zebradil You should not have to change mirror like that because one is down...

Zebradil commented 7 years ago

@mbelang What should I do then? Just wait?) It's effective solution while the main mirror is down.

mbelang commented 7 years ago

Well it depends if it is an urgency I guess, but for me it is one commit that will automatically be deployed and another commit to revert that duct tape that will also be deployed. All of that for no change..

andyshinn commented 7 years ago

The upstream mirror is down. I am updating the configuration to another one. It should be back in the next 5 minutes.

mbelang commented 7 years ago

I confirm it is back online. Thanks a lot

Zebradil commented 7 years ago

@mbelang I agree.

Skorpyon commented 7 years ago

@Zebradil Thank you, man! You save my ass )))

QSonx commented 7 years ago

All good here too. Thanks for the quick response to this.

Kapoor-uh commented 7 years ago

Hi I am trying to build up container using alpine:3.5, however,i am not able to move forward after these steps Sending build context to Docker daemon 3.588GB Step 1/17 : FROM alpine:3.5 ---> 074d602a59d7 Step 2/17 : MAINTAINER blabla ---> Using cache ---> e8bafda9c208 Step 3/17 : ENV http_proxy http://10.144.1.10:8080/ ---> Using cache ---> b02224fcf625 Step 4/17 : ENV https_proxy http://10.144.1.10:8080/ ---> Using cache ---> 6f7ebd10ff06 Step 5/17 : RUN apk add --update git py-virtualenv python-dev py-pip openjdk7-jre-base && pip install Flask && pip install gevent && pip install greenlet && pip install numpy && pip install requests RUN apk --update add gcc make g++ zlib-dev ---> Running in 5230e54c83ae fetch http://dl-cdn.alpinelinux.org/alpine/v3.5/main/x86_64/APKINDEX.tar.gz

The URL which docker build is trying to access (http://dl-cdn.alpinelinux.org/alpine/v3.5/main/x86_64/APKINDEX.tar.gz) is up. I have tried it couple of times and nothing moves after fetch http://dl-cdn.alpinelinux.org/alpine/v3.5/main/x86_64/APKINDEX.tar.gz, even i don't get any error.

scarothers commented 7 years ago

I know this issue is closed, but I'm seeing the same error now: 

fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz: temporary error (try again later)
fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz: temporary error (try again later)

When I open the URL in my browser, I see this:

Error 503 Backend is unhealthy

Backend is unhealthy

Guru Mediation:

Details: cache-dca17737-DCA 1501279301 2934117002

Varnish cache server

Our build is failing and we can't push out a change that needs to go out :(

andyshinn commented 7 years ago

That is an error from Fastly, the CDN. Can you provide the curl output including the headers?

$ curl -v -s -o /dev/null http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz
*   Trying 151.101.48.249...
* TCP_NODELAY set
* Connected to dl-cdn.alpinelinux.org (151.101.48.249) port 80 (#0)
> GET /alpine/v3.6/community/x86_64/APKINDEX.tar.gz HTTP/1.1
> Host: dl-cdn.alpinelinux.org
> User-Agent: curl/7.51.0
> Accept: */*
> 
< HTTP/1.1 200 OK
< Server: nginx
< Content-Type: application/octet-stream
< Last-Modified: Fri, 14 Jul 2017 22:20:57 GMT
< ETag: "596943c9-5b68a"
< Accept-Ranges: bytes
< Content-Length: 374410
< Accept-Ranges: bytes
< Date: Fri, 28 Jul 2017 22:40:58 GMT
< Via: 1.1 varnish
< Connection: keep-alive
< X-Served-By: cache-dfw1837-DFW
< X-Cache: MISS
< X-Cache-Hits: 0
< X-Timer: S1501281658.867729,VS0,VE296
btgoodwin commented 7 years ago

I'm getting the same error right now for v3.6. I was able to get one update through my CI pipeline a few minutes ago, and now it's dead again.

$ curl -v -s -o /dev/null http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz
* About to connect() to dl-cdn.alpinelinux.org port 80 (#0)
*   Trying 151.101.200.249...
* Connected to dl-cdn.alpinelinux.org (151.101.200.249) port 80 (#0)
> GET /alpine/v3.6/community/x86_64/APKINDEX.tar.gz HTTP/1.1
> User-Agent: curl/7.29.0
> Host: dl-cdn.alpinelinux.org
> Accept: */*
> 
< HTTP/1.1 503 Backend is unhealthy
< Server: Varnish
< Retry-After: 0
< Content-Type: text/html; charset=utf-8
< Content-Length: 455
< Accept-Ranges: bytes
< Date: Wed, 02 Aug 2017 16:03:29 GMT
< Via: 1.1 varnish
< Connection: close
< X-Served-By: cache-dca17733-DCA
< X-Cache: MISS
< X-Cache-Hits: 0
< X-Timer: S1501689810.553383,VS0,VE1
< 
{ [data not shown]
* Closing connection 0
dineshauti commented 7 years ago

Its still down. Any updates?

andyshinn commented 7 years ago

Can you also provide the headers output so we can try and correlate what might be going on here? So far, the last couple failures were all in the DCA region. I wonder if Fastly DCA is having some issues. I'll open up a thread with them if that seems to be the common denominator.

bob798 commented 7 years ago

I'm also getting the same error now for v3.6 .

WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz: remote server returned error (try 'apk update') ERROR: unsatisfiable constraints:

thomas-oo commented 7 years ago

Still getting the same error when I do RUN apk add --update curl [INFO] fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz [INFO] http://dl-cdn.alpinelinux.org/alpine/v3.6/main: temporary error (try again later) [INFO] WARNING: Ignoring APKINDEX.84815163.tar.gz: No such file or directory

I'm also getting a 301 moved permanently when I curl to http://dl-cdn.alpinelinux.org/alpine/v3.6/main

aquacode commented 7 years ago

Receiving same exact error output as of this moment:

fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz ERROR: http://dl-cdn.alpinelinux.org/alpine/v3.6/main: temporary error (try again later) WARNING: Ignoring APKINDEX.84815163.tar.gz: No such file or directory ERROR: http://dl-cdn.alpinelinux.org/alpine/v3.6/community: temporary error (try again later) WARNING: Ignoring APKINDEX.24d64ab1.tar.gz: No such file or directory OK: 4 MiB in 11 packages fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz ERROR: http://dl-cdn.alpinelinux.org/alpine/v3.6/main: temporary error (try again later) WARNING: Ignoring APKINDEX.84815163.tar.gz: No such file or directory

MarkTiedemann commented 7 years ago

Same error here.

fetch http://mirror.yandex.ru/mirrors/alpine/v3.6/main/x86_64/APKINDEX.tar.gz
ERROR: http://mirror.yandex.ru/mirrors/alpine/v3.6/main: temporary error (try again later)
fetch http://mirror.yandex.ru/mirrors/alpine/v3.6/main/x86_64/APKINDEX.tar.gz
fetch http://mirror.yandex.ru/mirrors/alpine/v3.6/community/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://mirror.yandex.ru/mirrors/alpine/v3.6/main/x86_64/APKINDEX.tar.gz: temporary error (try again later)
ERROR: http://mirror.yandex.ru/mirrors/alpine/v3.6/community: temporary error (try again later)
fetch http://mirror.yandex.ru/mirrors/alpine/v3.6/community/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://mirror.yandex.ru/mirrors/alpine/v3.6/community/x86_64/APKINDEX.tar.gz: temporary error (try again later)
codevbus commented 7 years ago

Getting this as well:

WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz: temporary error (try again later)
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz: temporary error (try again later)

What's strange is that I can do a wget from the host node and it downloads the APKINDEX.tar.gz file perfectly fine.

cpettifer commented 7 years ago

Same / similar problems here. I've tried updating repositories to use explicit mirror too and tried several that all show the same problem such as:

fetch http://repository.fit.cvut.cz/mirrors/alpine/v3.6/main/x86_64/APKINDEX.tar.gz
+ apk update
    fetch http://repository.fit.cvut.cz/mirrors/alpine/v3.6/community/x86_64/APKINDEX.tar.gz
ERROR: http://repository.fit.cvut.cz/mirrors/alpine/v3.6/main/: temporary error (try again later)
WARNING: Ignoring APKINDEX.33685f67.tar.gz: No such file or directory
    ERROR: http://repository.fit.cvut.cz/mirrors/alpine/v3.6/community/: temporary error (try again later)
WARNING: Ignoring APKINDEX.3aec0ff2.tar.gz: No such file or directory`

I can download the files directly on my host computer (running windows) and browse the directories fine in a browser.

Any clues? This is blocking me building and updating containers that are based on Alpine.

cpettifer commented 7 years ago

OK, oddly I was looking through similar issues and issue #155 suggested restarting Docker to resolve the issue. I didn't believe it, but tried it anyway.

It resolved my issue!

rcorre commented 7 years ago

I tried @Zebradil's suggestion to use a different mirror, but no luck:

fetch http://mirror.yandex.ru/mirrors/alpine/v3.4/main/x86_64/APKINDEX.tar.gz
ERROR: http://mirror.yandex.ru/mirrors/alpine/v3.4/main: temporary error (try again later)
WARNING: Ignoring APKINDEX.89669904.tar.gz: No such file or directory

This is only happening when I try to docker build a new image. If I start a shell inside a running image I can apk update just fine.

bhgames commented 7 years ago

I tried the different mirror too. However a shell also causes the issue.

MacBook-Air:opslab_cnc arkavon$ docker run -it 6471729507b9 sh
/app #  apk add --no-cache postgresql-dev git
fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz
WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz: 
temporary error (try again later)
/app #

Just began all of a sudden.

jmealo commented 7 years ago

I'm having the same issue (starting this morning). I'm probably going to switch to Debian due to the history of this happening for long periods of time.

You should be able to fix this using: DNS (better) or anycast (best).

I haven't used them personally but KeyCDN offers free hosting for Open Source. That should speed things up considerably and give you better reliability than whatever is going on here (as they offer anycast at multiple POPs).

adriandugan commented 7 years ago

@Zebradil response here worked for me this morning. Thanks! It would be good to see this resolved for good.

rosysalt commented 7 years ago

I also get similar issue:

15:54:22 fetch http://dl-cdn.alpinelinux.org/alpine/v3.4/main/x86_64/APKINDEX.tar.gz
15:54:27 ERROR: http://dl-cdn.alpinelinux.org/alpine/v3.4/main: temporary error (try again later)
15:54:27 WARNING: Ignoring APKINDEX.167438ca.tar.gz: No such file or directory
15:54:27 fetch http://dl-cdn.alpinelinux.org/alpine/v3.4/community/x86_64/APKINDEX.tar.gz
15:54:32 ERROR: http://dl-cdn.alpinelinux.org/alpine/v3.4/community: temporary error (try again later)
15:54:32 WARNING: Ignoring APKINDEX.a2e6dac0.tar.gz: No such file or directory

For me it's really strange because I got error if I do not provide the slash character / at the end of the URL

curl -v -s -o /dev/null http://dl-cdn.alpinelinux.org/alpine/v3.4/main/ # 200 OK
curl -v -s -o /dev/null http://dl-cdn.alpinelinux.org/alpine/v3.4/main # 301 Moved Permanently

The solution of @Zebradil here that @adriandugan mentioned above did not work for me. I would appreciate any input on how to resolve this issue for good.

andyshinn commented 7 years ago

Hmm, what is it trying to redirect to? It is possible this is related to bad upstream server.

laukotomi commented 7 years ago

I had the same issue today. It turned out that the docker bridge network stopped working.

So I created a new bridge network with this command: _docker network create --driver bridge networkname And started the docker build with this additional parameter: _--network networkname

I guess that parameter can also be used when starting a docker container.

rlewkowicz commented 6 years ago

This is still not fixed. I'm also having this issue.

Grinzzly commented 6 years ago

Yeah, not fixed yet. Waiting for solution.

xelex commented 6 years ago

I can confirm the problem.

peternormann commented 6 years ago

I had this issue as well this morning. I am running Docker CE on Windows 10 Pro.

I resolved it by changing the TCP IPv4 adapter settings on vEthernet (DockerNAT) to point to Google's DNS servers (8.8.8.8 and 8.8.4.4) and then restarting Docker.

marcstreeter commented 6 years ago

I have this issue too - seems as if it's a recurring issue from #264

davisn9 commented 6 years ago

Got the same issue today.

ejlp12 commented 6 years ago

Experiencing the same issue and was trying several alternative mirrors mentioned by @Zebradil but did not work. Curl/wget to the same URL from the host is working fine.

I found that it works on different machine (same OS version RHEL 7 and same Docker version 1.12.6, build 85d7426/1.12.6). Strange...

davisn9 commented 6 years ago

Thanks for the info.

gabrielmirandat commented 6 years ago

Do what @laukotomi suggested works here

sibil commented 6 years ago

It is happening again.

[ss@webdev ~]# wget http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz --2017-12-27 15:39:24-- http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz Resolving dl-cdn.alpinelinux.org (dl-cdn.alpinelinux.org)... 151.101.0.249, 151.101.64.249, 151.101.128.249, ... Connecting to dl-cdn.alpinelinux.org (dl-cdn.alpinelinux.org)|151.101.0.249|:80... connected. HTTP request sent, awaiting response... 503 Service Unavailable 2017-12-27 15:39:25 ERROR 503: Service Unavailable.

abduldjafar commented 6 years ago

WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.7/main/x86_64/APKINDEX.tar.gz: temporary error (try again later) WARNING: Ignoring http://dl-cdn.alpinelinux.org/alpine/v3.7/community/x86_64/APKINDEX.tar.gz: temporary error (try again later)

stilll get error like this

nicbou commented 6 years ago

Currently, http://dl-4.alpinelinux.org/alpine/3.6/community/x86_64/APKINDEX.tar.gz does not work either. Why are these repository URLs suddenly breaking? It's breaking docker's promise of reproducible builds.

EDIT: v3.6 instead of 3.6 fixed the URL for me. It used to work, but it doesn't anymore. Perhaps it's a different issue, but I'm leaving this here in case it helps someone else.

kvz commented 6 years ago

Same here, have to retry building 5 times and then it works. Each time it errors out on a different package like:

ERROR: make-4.1-r1: temporary error (try again later)
(2/22) Installing binutils-libs (2.26-r1)
ERROR: binutils-libs-2.26-r1: temporary error (try again later)

Sites go down all the time, that's fine, but is there a way to tell apk to retry itself a few times?

nicbou commented 6 years ago

@kvz, I think this is a separate problem. URLs should be semi-permanent (or at least return HTTP 301/302 when they change) to maintain reproducible builds, but the stability of third-party repositories is not an issue this project and its maintainers can tackle.

froodley commented 6 years ago

I have been getting these errors intermittently all week

javacraft commented 6 years ago

For what it is worth; this issue also arises when DNS cannot resolve repository URLs. Our users experience the same ERROR ... temporary error... because: (1) /etc/resolv.conf has incorrect or no nameserver entries; (2) upstream DNS server is down; and (3), believe it or not, their network cable is unplugged; the latter always deserving a /facepalm :)