20220824 频繁遇到429，是遇到什么问题了？

[j2gg0s]

20220824 频繁遇到429，是遇到什么问题了？

[aofei]

你好，麻烦提供一下具体问题的截图，CDN 日志里并未看到你提到的现象。

[j2gg0s]

[aofei]

本地是否存在譬如 HTTP_PROXY 之类的系统代理？

此外麻烦直接在相同环境下的终端执行下面的命令并贴出结果：

curl -iv https://goproxy.cn/cloud.google.com/go/@v/v0.100.2.mod

[j2gg0s]

curl -iv https://goproxy.cn/cloud.google.com/go/@v/v0.100.2.mod

• About to connect() to goproxy.cn port 443 (#0)
• Trying 112.65.203.41...
• Connected to goproxy.cn (112.65.203.41) port 443 (#0)
• Initializing NSS with certpath: sql:/etc/pki/nssdb
• CAfile: /etc/pki/tls/certs/ca-bundle.crt CApath: none
• SSL connection using TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256
• Server certificate:
• subject: CN=*.goproxy.cn
• start date: 7月 29 00:00:00 2022 GMT
• expire date: 8月 28 23:59:59 2023 GMT
• common name: *.goproxy.cn
• issuer: CN=TrustAsia RSA DV TLS CA G2,O="TrustAsia Technologies, Inc.",C=CN

  GET /cloud.google.com/go/@v/v0.100.2.mod HTTP/1.1 User-Agent: curl/7.29.0 Host: goproxy.cn Accept: /

  < HTTP/1.1 200 OK HTTP/1.1 200 OK < Server: JSP3/2.0.14 Server: JSP3/2.0.14 < Date: Wed, 24 Aug 2022 16:44:11 GMT Date: Wed, 24 Aug 2022 16:44:11 GMT < Content-Type: text/plain; charset=utf-8 Content-Type: text/plain; charset=utf-8 < Content-Length: 531 Content-Length: 531 < Connection: keep-alive Connection: keep-alive < Last-Modified: Wed, 05 Jan 2022 18:46:02 GMT Last-Modified: Wed, 05 Jan 2022 18:46:02 GMT < ETag: "QCFJ5kLzFSotJfmX/2pigw==" ETag: "QCFJ5kLzFSotJfmX/2pigw==" < Cache-Control: public, max-age=604800 Cache-Control: public, max-age=604800 < Age: 27 Age: 27 < Accept-Ranges: bytes Accept-Ranges: bytes < Strict-Transport-Security: max-age=31536000 Strict-Transport-Security: max-age=31536000 < X-M-Log: QNM:fn227;QNM3 X-M-Log: QNM:fn227;QNM3 < X-M-Reqid: iygAAKaar9Ok39MW X-M-Reqid: iygAAKaar9Ok39MW < X-Qnm-Cache: Hit X-Qnm-Cache: Hit < Timing-Allow-Origin: Timing-Allow-Origin: < Ohc-Cache-HIT: shun102 [2], zhuzuncache65 [1], suzix223 [4] Ohc-Cache-HIT: shun102 [2], zhuzuncache65 [1], suzix223 [4] < Ohc-File-Size: 531 Ohc-File-Size: 531 < X-Cache-Status: HIT X-Cache-Status: HIT

< module cloud.google.com/go

go 1.11

require ( cloud.google.com/go/compute v0.1.0 github.com/golang/protobuf v1.5.2 github.com/google/go-cmp v0.5.6 github.com/google/martian/v3 v3.2.1 github.com/googleapis/gax-go/v2 v2.1.1 go.opencensus.io v0.23.0 golang.org/x/oauth2 v0.0.0-20211104180415-d3ed0bb246c8 golang.org/x/xerrors v0.0.0-20200804184101-5ec99f83aff1 google.golang.org/api v0.63.0 google.golang.org/genproto v0.0.0-20211221195035-429b39de9b1c google.golang.org/grpc v1.40.1 google.golang.org/protobuf v1.27.1 )

• Connection #0 to host goproxy.cn left intact

[j2gg0s]

• 一个被调度的gitlab runner job，所以很难直接去发生的环境复现
• go mod 这儿不存在proxy
• 宿主机执行 go mod tidy 之类的暂时是ok的

goproxy.cn 没有大规模问题的话，我先看看我们自己的环境吧

[aofei]

curl 请求倒是没问题，所以怀疑你的环境中有其他类似 http_proxy 之类的代理或者全局代理什么的使得 go 的 http client 自动识别并应用了它，导致并且还没触及 goproxy.cn 就失败了，之所以说没触及是因为我并没有在 CDN 日志中查询到相应的错误响应。

[aofei]

goproxy.cn 没有大规模问题的话，我先看看我们自己的环境吧

嗯嗯好的，单从日志上看起来的确没有异常。

[j2gg0s]

我用 istio v1.13.7 做了个测试.

• go mod download 前后的 curl 都成功
• go mod download 还是会遇到 429
• go build 时候触发的 download 会成功

DockerFile:

FROM golang:1.17-alpine AS build

RUN set -ex && \
    apk --no-cache --update add \
        git curl

ENV GOARCH=amd64 \
    CGO_ENABLED=0

WORKDIR /go/src

COPY go.mod .
COPY go.sum .

RUN curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info && GOPROXY=goproxy.cn,direct go mod download || curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info

COPY . .

RUN GOPROXY=goproxy.cn,direct go build istioctl/cmd/istioctl/main.go

[wjwzero]

我也遇到429了

[j2gg0s]

额外说一句，还是非常感觉 goproxy.cn 提供的种种便利的

[j2gg0s]

一些日志：

我用 istio v1.13.7 做了个测试.

• go mod download 前后的 curl 都成功
• go mod download 还是会遇到 429
• go build 时候触发的 download 会成功

DockerFile:

FROM golang:1.17-alpine AS build

RUN set -ex && \
    apk --no-cache --update add \
        git curl

ENV GOARCH=amd64 \
    CGO_ENABLED=0

WORKDIR /go/src

COPY go.mod .
COPY go.sum .

RUN curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info && GOPROXY=goproxy.cn,direct go mod download || curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info

COPY . .

RUN GOPROXY=goproxy.cn,direct go build istioctl/cmd/istioctl/main.go

完整的日志： Sending build context to Docker daemon 273.4MB

Step 1/9 : FROM golang:1.17-alpine AS build ---> 270c4f58750f Step 2/9 : RUN set -ex && apk --no-cache --update add git curl ---> Using cache ---> fece1fc4e8ce Step 3/9 : ENV GOARCH=amd64 CGO_ENABLED=0 ---> Using cache ---> 6294242b3683 Step 4/9 : WORKDIR /go/src ---> Using cache ---> 649cad5c7268 Step 5/9 : COPY go.mod . ---> Using cache ---> b90a607a4711 Step 6/9 : COPY go.sum . ---> Using cache ---> 744ada6a5a5e Step 7/9 : RUN echo "invalid cache" && curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info && GOPROXY=goproxy.cn,direct go mod download || curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info ---> Running in 4084cb83926f invalid cache  % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 Trying 112.65.203.41:443...  Connected to goproxy.cn (112.65.203.41) port 443 (#0) * ALPN: offers h2

• ALPN: offers http/1.1 * CAfile: /etc/ssl/certs/ca-certificates.crt
• CApath: none } [5 bytes data]
• TLSv1.3 (OUT), TLS handshake, Client hello (1): } [512 bytes data] * TLSv1.3 (IN), TLS handshake, Server hello (2): { [122 bytes data]
• TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8): { [19 bytes data]
• TLSv1.3 (IN), TLS handshake, Certificate (11): { [2959 bytes data] * TLSv1.3 (IN), TLS handshake, CERT verify (15): { [264 bytes data]
• TLSv1.3 (IN), TLS handshake, Finished (20): { [52 bytes data]
• TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1): } [1 bytes data] * TLSv1.3 (OUT), TLS handshake, Finished (20): } [52 bytes data]
• SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
• ALPN: server accepted h2
• Server certificate:
• subject: CN=*.goproxy.cn
• start date: Jul 29 00:00:00 2022 GMT
• expire date: Aug 28 23:59:59 2023 GMT
• subjectAltName: host "goproxy.cn" matched cert's "goproxy.cn"
• issuer: C=CN; O=TrustAsia Technologies, Inc.; CN=TrustAsia RSA DV TLS CA G2
• SSL certificate verify ok.
• Using HTTP2, server supports multiplexing
• Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0 } [5 bytes data]
• h2h3 [:method: GET]
• h2h3 [:path: /cloud.google.com/go/iam/@v/v0.3.0.info]
• h2h3 [:scheme: https]
• h2h3 [:authority: goproxy.cn]
• h2h3 [user-agent: curl/7.83.1]
• h2h3 [accept: /]
• Using Stream ID: 1 (easy handle 0x7f6b98e851b0) } [5 bytes data] > GET /cloud.google.com/go/iam/@v/v0.3.0.info HTTP/2

  Host: goproxy.cn user-agent: curl/7.83.1 accept: /

  { [5 bytes data]

• TLSv1.3 (IN), TLS handshake, Newsession Ticket (4): { [265 bytes data]
• TLSv1.3 (IN), TLS handshake, Newsession Ticket (4): { [265 bytes data]
• old SSL session ID is stale, removing { [5 bytes data]
• Connection state changed (MAX_CONCURRENT_STREAMS == 128)! } [5 bytes data] < HTTP/2 200 < server: JSP3/2.0.14 < date: Thu, 25 Aug 2022 03:01:11 GMT < content-type: application/json; charset=utf-8 < content-length: 50 < last-modified: Wed, 02 Mar 2022 20:23:38 GMT < etag: "1gxk4mO8E43r5PRs7/ahgQ==" < cache-control: public, max-age=604800 < age: 404877 < accept-ranges: bytes < strict-transport-security: max-age=31536000 < x-m-log: QNM:fn269;QNM3 < x-m-reqid: L5YAAKGi0DDLzdwW < x-qnm-cache: Hit < timing-allow-origin: * < ohc-cache-hit: shun69 [4], xzuncache69 [4], qdix144 [4] < ohc-file-size: 50 < x-cache-status: HIT < { [50 bytes data]

100 50 100 50 0 0 737 0 --:--:-- --:--:-- --:--:-- 746

• Connection #0 to host goproxy.cn left intact HTTP/2 200 server: JSP3/2.0.14 date: Thu, 25 Aug 2022 03:01:11 GMT content-type: application/json; charset=utf-8 content-length: 50 last-modified: Wed, 02 Mar 2022 20:23:38 GMT etag: "1gxk4mO8E43r5PRs7/ahgQ==" cache-control: public, max-age=604800 age: 404877 accept-ranges: bytes strict-transport-security: max-age=31536000 x-m-log: QNM:fn269;QNM3 x-m-reqid: L5YAAKGi0DDLzdwW x-qnm-cache: Hit timing-allow-origin: * ohc-cache-hit: shun69 [4], xzuncache69 [4], qdix144 [4] ohc-file-size: 50 x-cache-status: HIT

{"Version":"v0.3.0","Time":"2022-02-23T23:28:47Z"}go mod download: bazil.org/fuse@v0.0.0-20160811212531-371fbbdaa898: reading https://goproxy.cn/bazil.org/fuse/@v/v0.0.0-20160811212531-371fbbdaa898.mod: 429 Too Many Requests go mod download: cloud.google.com/go/logging@v1.4.2: reading https://goproxy.cn/cloud.google.com/go/logging/@v/v1.4.2.info: 429 Too Many Requests go mod download: github.com/AdaLogics/go-fuzz-headers@v0.0.0-20220511133513-5ae53b7a8154: reading https://goproxy.cn/github.com/%21ada%21logics/go-fuzz-headers/@v/v0.0.0-20220511133513-5ae53b7a8154.info: 429 Too Many Requests go mod download: github.com/Azure/go-autorest/autorest@v0.11.27: reading https://goproxy.cn/github.com/%21azure/go-autorest/autorest/@v/v0.11.27.info: 429 Too Many Requests go mod download: github.com/Azure/go-autorest/autorest/to@v0.4.0: reading https://goproxy.cn/github.com/%21azure/go-autorest/autorest/to/@v/v0.4.0.info: 429 Too Many Requests go mod download: github.com/Azure/go-autorest/tracing@v0.6.0: reading https://goproxy.cn/github.com/%21azure/go-autorest/tracing/@v/v0.6.0.info: 429 Too Many Requests go mod download: github.com/Masterminds/semver@v1.5.0: reading https://goproxy.cn/github.com/%21masterminds/semver/@v/v1.5.0.mod: 429 Too Many Requests go mod download: github.com/Masterminds/semver/v3@v3.1.1: reading https://goproxy.cn/github.com/%21masterminds/semver/v3/@v/v3.1.1.info: 429 Too Many Requests go mod download: github.com/NYTimes/gziphandler@v1.1.1: reading https://goproxy.cn/github.com/%21n%21y%21times/gziphandler/@v/v1.1.1.info: 429 Too Many Requests go mod download: github.com/OneOfOne/xxhash@v1.2.2: reading https://goproxy.cn/github.com/%21one%21of%21one/xxhash/@v/v1.2.2.mod: 429 Too Many Requests go mod download: github.com/StackExchange/wmi@v1.2.1: reading https://goproxy.cn/github.com/%21stack%21exchange/wmi/@v/v1.2.1.info: 429 Too Many Requests go mod download: github.com/alecthomas/participle@v0.4.1: reading https://goproxy.cn/github.com/alecthomas/participle/@v/v0.4.1.info: 429 Too Many Requests go mod download: github.com/alecthomas/units@v0.0.0-20211218093645-b94a6e3cc137: reading https://goproxy.cn/github.com/alecthomas/units/@v/v0.0.0-20211218093645-b94a6e3cc137.mod: 429 Too Many Requests go mod download: github.com/alexkohler/prealloc@v1.0.0: reading https://goproxy.cn/github.com/alexkohler/prealloc/@v/v1.0.0.info: 429 Too Many Requests go mod download: github.com/andybalholm/brotli@v1.0.3: reading https://goproxy.cn/github.com/andybalholm/brotli/@v/v1.0.3.mod: 429 Too Many Requests go mod download: github.com/armon/go-metrics@v0.3.10: reading https://goproxy.cn/github.com/armon/go-metrics/@v/v0.3.10.info: 429 Too Many Requests go mod download: github.com/beorn7/perks@v1.0.1: reading https://goproxy.cn/github.com/beorn7/perks/@v/v1.0.1.info: 429 Too Many Requests go mod download: github.com/bits-and-blooms/bitset@v1.2.0: reading https://goproxy.cn/github.com/bits-and-blooms/bitset/@v/v1.2.0.mod: 429 Too Many Requests go mod download: github.com/bketelsen/crypt@v0.0.4: reading https://goproxy.cn/github.com/bketelsen/crypt/@v/v0.0.4.mod: 429 Too Many Requests go mod download: github.com/blang/semver@v3.5.1+incompatible: reading https://goproxy.cn/github.com/blang/semver/@v/v3.5.1+incompatible.mod: 429 Too Many Requests go mod download: github.com/blizzy78/varnamelen@v0.3.0: reading https://goproxy.cn/github.com/blizzy78/varnamelen/@v/v0.3.0.info: 429 Too Many Requests go mod download: github.com/buger/jsonparser@v1.1.1: reading https://goproxy.cn/github.com/buger/jsonparser/@v/v1.1.1.info: 429 Too Many Requests go mod download: github.com/bugsnag/osext@v0.0.0-20130617224835-0dd3f918b21b: reading https://goproxy.cn/github.com/bugsnag/osext/@v/v0.0.0-20130617224835-0dd3f918b21b.info: 429 Too Many Requests go mod download: github.com/census-instrumentation/opencensus-proto@v0.3.0: reading https://goproxy.cn/github.com/census-instrumentation/opencensus-proto/@v/v0.3.0.info: 429 Too Many Requests go mod download: github.com/certifi/gocertifi@v0.0.0-20200922220541-2c3bb06c6054: reading https://goproxy.cn/github.com/certifi/gocertifi/@v/v0.0.0-20200922220541-2c3bb06c6054.mod: 429 Too Many Requests go mod download: github.com/charithe/durationcheck@v0.0.9: reading https://goproxy.cn/github.com/charithe/durationcheck/@v/v0.0.9.info: 429 Too Many Requests go mod download: github.com/chavacava/garif@v0.0.0-20210405164556-e8a0a408d6af: reading https://goproxy.cn/github.com/chavacava/garif/@v/v0.0.0-20210405164556-e8a0a408d6af.mod: 429 Too Many Requests go mod download: github.com/checkpoint-restore/go-criu/v5@v5.0.0: reading https://goproxy.cn/github.com/checkpoint-restore/go-criu/v5/@v/v5.0.0.mod: 429 Too Many Requests go mod download: github.com/chzyer/readline@v1.5.0: reading https://goproxy.cn/github.com/chzyer/readline/@v/v1.5.0.mod: 429 Too Many Requests go mod download: github.com/cilium/ebpf@v0.6.2: reading https://goproxy.cn/github.com/cilium/ebpf/@v/v0.6.2.mod: 429 Too Many Requests go mod download: github.com/cncf/udpa/go@v0.0.0-20210930031921-04548b0d99d4: reading https://goproxy.cn/github.com/cncf/udpa/go/@v/v0.0.0-20210930031921-04548b0d99d4.info: 429 Too Many Requests go mod download: github.com/cockroachdb/datadriven@v0.0.0-20200714090401-bf6692d28da5: reading https://goproxy.cn/github.com/cockroachdb/datadriven/@v/v0.0.0-20200714090401-bf6692d28da5.mod: 429 Too Many Requests go mod download: github.com/containerd/console@v1.0.3: reading https://goproxy.cn/github.com/containerd/console/@v/v1.0.3.mod: 429 Too Many Requests go mod download: github.com/containerd/continuity@v0.2.3-0.20220330195504-d132b287edc8: reading https://goproxy.cn/github.com/containerd/continuity/@v/v0.2.3-0.20220330195504-d132b287edc8.mod: 429 Too Many Requests go mod download: github.com/containerd/nri@v0.1.0: reading https://goproxy.cn/github.com/containerd/nri/@v/v0.1.0.info: 429 Too Many Requests go mod download: github.com/containerd/ttrpc@v1.1.0: reading https://goproxy.cn/github.com/containerd/ttrpc/@v/v1.1.0.mod: 429 Too Many Requests go mod download: github.com/containernetworking/plugins@v1.1.1: reading https://goproxy.cn/github.com/containernetworking/plugins/@v/v1.1.1.info: 429 Too Many Requests go mod download: github.com/containers/ocicrypt@v1.1.1: reading https://goproxy.cn/github.com/containers/ocicrypt/@v/v1.1.1.mod: 429 Too Many Requests go mod download: github.com/coreos/go-semver@v0.3.0: reading https://goproxy.cn/github.com/coreos/go-semver/@v/v0.3.0.info: 429 Too Many Requests go mod download: github.com/coreos/go-systemd@v0.0.0-20190321100706-95778dfbb74e: reading https://goproxy.cn/github.com/coreos/go-systemd/@v/v0.0.0-20190321100706-95778dfbb74e.mod: 429 Too Many Requests go mod download: github.com/coreos/pkg@v0.0.0-20180928190104-399ea9e2e55f: reading https://goproxy.cn/github.com/coreos/pkg/@v/v0.0.0-20180928190104-399ea9e2e55f.mod: 429 Too Many Requests go mod download: github.com/cpuguy83/go-md2man@v1.0.10: reading https://goproxy.cn/github.com/cpuguy83/go-md2man/@v/v1.0.10.mod: 429 Too Many Requests go mod download: github.com/cpuguy83/go-md2man/v2@v2.0.2: reading https://goproxy.cn/github.com/cpuguy83/go-md2man/v2/@v/v2.0.2.info: 429 Too Many Requests go mod download: github.com/d2g/dhcp4@v0.0.0-20170904100407-a1d1b6c41b1c: reading https://goproxy.cn/github.com/d2g/dhcp4/@v/v0.0.0-20170904100407-a1d1b6c41b1c.mod: 429 Too Many Requests go mod download: github.com/d2g/dhcp4client@v1.0.0: reading https://goproxy.cn/github.com/d2g/dhcp4client/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/d2g/dhcp4server@v0.0.0-20181031114812-7d4a0a7f59a5: reading https://goproxy.cn/github.com/d2g/dhcp4server/@v/v0.0.0-20181031114812-7d4a0a7f59a5.mod: 429 Too Many Requests go mod download: github.com/d2g/hardwareaddr@v0.0.0-20190221164911-e7d9fbe030e4: reading https://goproxy.cn/github.com/d2g/hardwareaddr/@v/v0.0.0-20190221164911-e7d9fbe030e4.info: 429 Too Many Requests go mod download: github.com/decred/dcrd/crypto/blake256@v1.0.0: reading https://goproxy.cn/github.com/decred/dcrd/crypto/blake256/@v/v1.0.0.info: 429 Too Many Requests go mod download: github.com/dgrijalva/jwt-go@v3.2.0+incompatible: reading https://goproxy.cn/github.com/dgrijalva/jwt-go/@v/v3.2.0+incompatible.mod: 429 Too Many Requests go mod download: github.com/ettle/strcase@v0.1.1: reading https://goproxy.cn/github.com/ettle/strcase/@v/v0.1.1.mod: 429 Too Many Requests go mod download: github.com/fatih/structtag@v1.2.0: reading https://goproxy.cn/github.com/fatih/structtag/@v/v1.2.0.mod: 429 Too Many Requests go mod download: github.com/go-ole/go-ole@v1.2.6: reading https://goproxy.cn/github.com/go-ole/go-ole/@v/v1.2.6.mod: 429 Too Many Requests go mod download: github.com/go-sql-driver/mysql@v1.4.0: reading https://goproxy.cn/github.com/go-sql-driver/mysql/@v/v1.4.0.mod: 429 Too Many Requests go mod download: github.com/go-toolsmith/astcopy@v1.0.0: reading https://goproxy.cn/github.com/go-toolsmith/astcopy/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/go-toolsmith/astequal@v1.0.1: reading https://goproxy.cn/github.com/go-toolsmith/astequal/@v/v1.0.1.mod: 429 Too Many Requests go mod download: github.com/go-toolsmith/astfmt@v1.0.0: reading https://goproxy.cn/github.com/go-toolsmith/astfmt/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/go-toolsmith/astp@v1.0.0: reading https://goproxy.cn/github.com/go-toolsmith/astp/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/go-toolsmith/pkgload@v1.0.0: reading https://goproxy.cn/github.com/go-toolsmith/pkgload/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/go-toolsmith/strparse@v1.0.0: reading https://goproxy.cn/github.com/go-toolsmith/strparse/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/go-toolsmith/typep@v1.0.2: reading https://goproxy.cn/github.com/go-toolsmith/typep/@v/v1.0.2.mod: 429 Too Many Requests go mod download: github.com/godbus/dbus@v0.0.0-20180201030542-885f9cc04c9c: reading https://goproxy.cn/github.com/godbus/dbus/@v/v0.0.0-20180201030542-885f9cc04c9c.mod: 429 Too Many Requests go mod download: github.com/google/renameio@v0.1.0: reading https://goproxy.cn/github.com/google/renameio/@v/v0.1.0.mod: 429 Too Many Requests go mod download: github.com/gookit/color@v1.4.2: reading https://goproxy.cn/github.com/gookit/color/@v/v1.4.2.mod: 429 Too Many Requests go mod download: github.com/gostaticanalysis/analysisutil@v0.7.1: reading https://goproxy.cn/github.com/gostaticanalysis/analysisutil/@v/v0.7.1.mod: 429 Too Many Requests go mod download: github.com/gostaticanalysis/comment@v1.4.1: reading https://goproxy.cn/github.com/gostaticanalysis/comment/@v/v1.4.1.mod: 429 Too Many Requests go mod download: github.com/gostaticanalysis/testutil@v0.4.0: reading https://goproxy.cn/github.com/gostaticanalysis/testutil/@v/v0.4.0.mod: 429 Too Many Requests go mod download: github.com/hpcloud/tail@v1.0.0: reading https://goproxy.cn/github.com/hpcloud/tail/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/j-keck/arping@v0.0.0-20160618110441-2cf9dc699c56: reading https://goproxy.cn/github.com/j-keck/arping/@v/v0.0.0-20160618110441-2cf9dc699c56.mod: 429 Too Many Requests go mod download: github.com/konsorten/go-windows-terminal-sequences@v1.0.3: reading https://goproxy.cn/github.com/konsorten/go-windows-terminal-sequences/@v/v1.0.3.mod: 429 Too Many Requests go mod download: github.com/kr/pty@v1.1.5: reading https://goproxy.cn/github.com/kr/pty/@v/v1.1.5.mod: 429 Too Many Requests go mod download: github.com/logrusorgru/aurora@v0.0.0-20181002194514-a7b3b318ed4e: reading https://goproxy.cn/github.com/logrusorgru/aurora/@v/v0.0.0-20181002194514-a7b3b318ed4e.mod: 429 Too Many Requests go mod download: github.com/lufia/plan9stats@v0.0.0-20211012122336-39d0f177ccd0: reading https://goproxy.cn/github.com/lufia/plan9stats/@v/v0.0.0-20211012122336-39d0f177ccd0.mod: 429 Too Many Requests go mod download: github.com/matryer/is@v1.4.0: reading https://goproxy.cn/github.com/matryer/is/@v/v1.4.0.mod: 429 Too Many Requests go mod download: github.com/mattn/goveralls@v0.0.2: reading https://goproxy.cn/github.com/mattn/goveralls/@v/v0.0.2.mod: 429 Too Many Requests go mod download: github.com/mistifyio/go-zfs@v2.1.2-0.20190413222219-f784269be439+incompatible: reading https://goproxy.cn/github.com/mistifyio/go-zfs/@v/v2.1.2-0.20190413222219-f784269be439+incompatible.mod: 429 Too Many Requests go mod download: github.com/mozilla/tls-observatory@v0.0.0-20210609171429-7bc42856d2e5: reading https://goproxy.cn/github.com/mozilla/tls-observatory/@v/v0.0.0-20210609171429-7bc42856d2e5.mod: 429 Too Many Requests go mod download: github.com/mrunalp/fileutils@v0.5.0: reading https://goproxy.cn/github.com/mrunalp/fileutils/@v/v0.5.0.mod: 429 Too Many Requests go mod download: github.com/nbutton23/zxcvbn-go@v0.0.0-20210217022336-fa2cb2858354: reading https://goproxy.cn/github.com/nbutton23/zxcvbn-go/@v/v0.0.0-20210217022336-fa2cb2858354.mod: 429 Too Many Requests go mod download: github.com/olekukonko/tablewriter@v0.0.5: reading https://goproxy.cn/github.com/olekukonko/tablewriter/@v/v0.0.5.mod: 429 Too Many Requests go mod download: github.com/otiai10/copy@v1.2.0: reading https://goproxy.cn/github.com/otiai10/copy/@v/v1.2.0.mod: 429 Too Many Requests go mod download: github.com/pborman/uuid@v1.2.0: reading https://goproxy.cn/github.com/pborman/uuid/@v/v1.2.0.mod: 429 Too Many Requests go mod download: github.com/phayes/checkstyle@v0.0.0-20170904204023-bfd46e6a821d: reading https://goproxy.cn/github.com/phayes/checkstyle/@v/v0.0.0-20170904204023-bfd46e6a821d.mod: 429 Too Many Requests go mod download: github.com/quasilyte/go-consistent@v0.0.0-20190521200055-c6f3937de18c: reading https://goproxy.cn/github.com/quasilyte/go-consistent/@v/v0.0.0-20190521200055-c6f3937de18c.mod: 429 Too Many Requests go mod download: github.com/quasilyte/go-ruleguard/rules@v0.0.0-20210428214800-545e0d2e0bf7: reading https://goproxy.cn/github.com/quasilyte/go-ruleguard/rules/@v/v0.0.0-20210428214800-545e0d2e0bf7.mod: 429 Too Many Requests go mod download: github.com/quasilyte/regex/syntax@v0.0.0-20200407221936-30656e2c4a95: reading https://goproxy.cn/github.com/quasilyte/regex/syntax/@v/v0.0.0-20200407221936-30656e2c4a95.mod: 429 Too Many Requests go mod download: github.com/seccomp/libseccomp-golang@v0.9.1: reading https://goproxy.cn/github.com/seccomp/libseccomp-golang/@v/v0.9.1.mod: 429 Too Many Requests go mod download: github.com/shurcooL/go@v0.0.0-20180423040247-9e1955d9fb6e: reading https://goproxy.cn/github.com/shurcoo%21l/go/@v/v0.0.0-20180423040247-9e1955d9fb6e.mod: 429 Too Many Requests go mod download: github.com/shurcooL/go-goon@v0.0.0-20170922171312-37c2f522c041: reading https://goproxy.cn/github.com/shurcoo%21l/go-goon/@v/v0.0.0-20170922171312-37c2f522c041.mod: 429 Too Many Requests go mod download: github.com/shurcooL/sanitized_anchor_name@v1.0.0: reading https://goproxy.cn/github.com/shurcoo%21l/sanitized_anchor_name/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/smartystreets/goconvey@v1.6.4: reading https://goproxy.cn/github.com/smartystreets/goconvey/@v/v1.6.4.mod: 429 Too Many Requests go mod download: github.com/syndtr/gocapability@v0.0.0-20200815063812-42c35b437635: reading https://goproxy.cn/github.com/syndtr/gocapability/@v/v0.0.0-20200815063812-42c35b437635.mod: 429 Too Many Requests go mod download: github.com/tenntenn/modver@v1.0.1: reading https://goproxy.cn/github.com/tenntenn/modver/@v/v1.0.1.mod: 429 Too Many Requests go mod download: github.com/tenntenn/text/transform@v0.0.0-20200319021203-7eef512accb3: reading https://goproxy.cn/github.com/tenntenn/text/transform/@v/v0.0.0-20200319021203-7eef512accb3.mod: 429 Too Many Requests go mod download: github.com/tklauser/go-sysconf@v0.3.9: reading https://goproxy.cn/github.com/tklauser/go-sysconf/@v/v0.3.9.mod: 429 Too Many Requests go mod download: github.com/valyala/bytebufferpool@v1.0.0: reading https://goproxy.cn/github.com/valyala/bytebufferpool/@v/v1.0.0.mod: 429 Too Many Requests go mod download: github.com/valyala/fasthttp@v1.30.0: reading https://goproxy.cn/github.com/valyala/fasthttp/@v/v1.30.0.mod: 429 Too Many Requests go mod download: go.etcd.io/etcd@v0.5.0-alpha.5.0.20200910180754-dd1b699fc489: reading https://goproxy.cn/go.etcd.io/etcd/@v/v0.5.0-alpha.5.0.20200910180754-dd1b699fc489.mod: 429 Too Many Requests go mod download: golang.org/x/build@v0.0.0-20190111050920-041ab4dc3f9d: reading https://goproxy.cn/golang.org/x/build/@v/v0.0.0-20190111050920-041ab4dc3f9d.mod: 429 Too Many Requests go mod download: gopkg.in/airbrake/gobrake.v2@v2.0.9: reading https://goproxy.cn/gopkg.in/airbrake/gobrake.v2/@v/v2.0.9.mod: 429 Too Many Requests go mod download: gopkg.in/fsnotify.v1@v1.4.7: reading https://goproxy.cn/gopkg.in/fsnotify.v1/@v/v1.4.7.mod: 429 Too Many Requests go mod download: gopkg.in/gemnasium/logrus-airbrake-hook.v2@v2.1.2: reading https://goproxy.cn/gopkg.in/gemnasium/logrus-airbrake-hook.v2/@v/v2.1.2.mod: 429 Too Many Requests go mod download: gotest.tools@v2.2.0+incompatible: reading https://goproxy.cn/gotest.tools/@v/v2.2.0+incompatible.mod: 429 Too Many Requests go mod download: rsc.io/binaryregexp@v0.2.0: reading https://goproxy.cn/rsc.io/binaryregexp/@v/v0.2.0.mod: 429 Too Many Requests go mod download: rsc.io/quote/v3@v3.1.0: reading https://goproxy.cn/rsc.io/quote/v3/@v/v3.1.0.mod: 429 Too Many Requests  % Total % Received % Xferd Average Speed Time  Time  Time Current             Dload  Upload  Total  Spent  Left Speed

0  0  0  0 0  0  0  0 --:--:-- --:--:-- --:--:-- 0 Trying 112.65.203.41:443...  Connected to goproxy.cn (112.65.203.41) port 443 (#0) * ALPN: offers h2

• ALPN: offers http/1.1 * CAfile: /etc/ssl/certs/ca-certificates.crt
• CApath: none } [5 bytes data]  TLSv1.3 (OUT), TLS handshake, Client hello (1): } [512 bytes data]  TLSv1.3 (IN), TLS handshake, Server hello (2): { [122 bytes data]  TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8): { [19 bytes data]  TLSv1.3 (IN), TLS handshake, Certificate (11): { [2959 bytes data]  TLSv1.3 (IN), TLS handshake, CERT verify (15): { [264 bytes data]  TLSv1.3 (IN), TLS handshake, Finished (20): { [52 bytes data]  TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1): } [1 bytes data]  TLSv1.3 (OUT), TLS handshake, Finished (20): } [52 bytes data] * SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
• ALPN: server accepted h2 * Server certificate:
• subject: CN=*.goproxy.cn
• start date: Jul 29 00:00:00 2022 GMT  expire date: Aug 28 23:59:59 2023 GMT  subjectAltName: host "goproxy.cn" matched cert's "goproxy.cn" * issuer: C=CN; O=TrustAsia Technologies, Inc.; CN=TrustAsia RSA DV TLS CA G2
• SSL certificate verify ok. * Using HTTP2, server supports multiplexing
• Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0 } [5 bytes data] * h2h3 [:method: GET]
• h2h3 [:path: /cloud.google.com/go/iam/@v/v0.3.0.info]
• h2h3 [:scheme: https]  h2h3 [:authority: goproxy.cn]  h2h3 [user-agent: curl/7.83.1]  h2h3 [accept: /]  Using Stream ID: 1 (easy handle 0x7f93de9611b0) } [5 bytes data] > GET /cloud.google.com/go/iam/@v/v0.3.0.info HTTP/2

  Host: goproxy.cn user-agent: curl/7.83.1 accept: / > { [5 bytes data]  TLSv1.3 (IN), TLS handshake, Newsession Ticket (4): { [265 bytes data]  TLSv1.3 (IN), TLS handshake, Newsession Ticket (4): { [265 bytes data]  old SSL session ID is stale, removing { [5 bytes data]  Connection state changed (MAX_CONCURRENT_STREAMS == 128)! } [5 bytes data] < HTTP/2 200 < server: JSP3/2.0.14 < date: Thu, 25 Aug 2022 03:01:46 GMT < content-type: application/json; charset=utf-8 < content-length: 50 < last-modified: Wed, 02 Mar 2022 20:23:38 GMT < etag: "1gxk4mO8E43r5PRs7/ahgQ==" <HTTP/2 200  cache-control: public, max-age=604800 < age: 404912 < accept-ranges: bytes < strict-transport-security: max-age=31536000 < x-m-log: QNM:fn269;QNM3 < x-m-reqid: L5YAAKGi0DDLzdwW < x-qnm-cache: Hit < timing-allow-origin: < ohc-cache-hit: shun69 [2], xzuncache69 [4], qdix144 [4] < ohc-file-size: 50 < x-cache-status: HIT <  { [50 bytes data]  100 50 100  50  0 0 1114  0 --:--:-- --:--:-- --:--:-- 1136  Connection #0 to host goproxy.cn left intact server: JSP3/2.0.14 date: Thu, 25 Aug 2022 03:01:46 GMT content-type: application/json; charset=utf-8 content-length: 50 last-modified: Wed, 02 Mar 2022 20:23:38 GMT etag: "1gxk4mO8E43r5PRs7/ahgQ==" cache-control: public, max-age=604800 age: 404912 accept-ranges: bytes strict-transport-security: max-age=31536000 x-m-log: QNM:fn269;QNM3 x-m-reqid: L5YAAKGi0DDLzdwW x-qnm-cache: Hit timing-allow-origin: * ohc-cache-hit: shun69 [2], xzuncache69 [4], qdix144 [4] ohc-file-size: 50 x-cache-status: HIT

{"Version":"v0.3.0","Time":"2022-02-23T23:28:47Z"}Removing intermediate container 4084cb83926f ---> cedf967f76fa Step 8/9 : COPY . . ---> c514dd3f3da6 Step 9/9 : RUN GOPROXY=goproxy.cn,direct go build istioctl/cmd/istioctl/main.go ---> Running in 7c31b3038e7d go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading cloud.google.com/go/logging v1.4.2 go: downloading github.com/Azure/go-autorest/autorest v0.11.27 go: downloading github.com/census-instrumentation/opencensus-proto v0.3.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/Masterminds/semver/v3 v3.1.1 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 Removing intermediate container 7c31b3038e7d ---> 5f1df1904464 Successfully built 5f1df1904464

[hr3685930]

429 前来寻答案~~

[j2gg0s]

我用 istio v1.13.7 做了个测试.

• go mod download 前后的 curl 都成功
• go mod download 还是会遇到 429
• go build 时候触发的 download 会成功

DockerFile:

FROM golang:1.17-alpine AS build

RUN set -ex && \
    apk --no-cache --update add \
        git curl

ENV GOARCH=amd64 \
    CGO_ENABLED=0

WORKDIR /go/src

COPY go.mod .
COPY go.sum .

RUN curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info && GOPROXY=goproxy.cn,direct go mod download || curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info

COPY . .

RUN GOPROXY=goproxy.cn,direct go build istioctl/cmd/istioctl/main.go

这个可以作为一个临时的规避手段

[Suozz]

我用 istio v1.13.7 做了个测试.

• go mod download 前后的 curl 都成功
• go mod download 还是会遇到 429
• go build 时候触发的 download 会成功

DockerFile:

FROM golang:1.17-alpine AS build

RUN set -ex && \
    apk --no-cache --update add \
        git curl

ENV GOARCH=amd64 \
    CGO_ENABLED=0

WORKDIR /go/src

COPY go.mod .
COPY go.sum .

RUN curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info && GOPROXY=goproxy.cn,direct go mod download || curl -iv https://goproxy.cn/cloud.google.com/go/iam/@v/v0.3.0.info

COPY . .

RUN GOPROXY=goproxy.cn,direct go build istioctl/cmd/istioctl/main.go

这个可以作为一个临时的规避手段

我这每次报错的包名都不一样。

[Suozz]

[hr3685930]

kaniko 构建今天一直429

[yhxjack]

我也遇到了429

[samyanyan]

有个项目一致出现这个，但是也有个别项目没有出现

[yhxjack]

[iGoogle-ink]

我这两天也频繁遇到这个问题， 429 Too Many Requests

[yhxjack]

我这两天也频繁遇到这个问题， 429 Too Many Requests

我的一致构建是这个错误，过不去，你这边重试能解决吗

[iGoogle-ink]

429 Too Many Requests

有时候好，有时候不好，概率性问题，但是概率还挺大的

[aofei]

如果 CDN 日志 API 返回的结果没错，今天截止目前为止总共出现过 268 条 429 响应，占比还是非常小的，不过这依旧是一个会导致 CI/CD 等自动构建机制失败的致命错误，我们正在排查当中。

Update (2022-08-25 11:58:47): 根据 CDN 日志反映，最近 30 天内，最早的一条 429 响应出现在 2022-08-24 21:30:48，截止目前共出现过 363 条。

[iGoogle-ink]

我这边很频繁，连续做好几次构建，可能才成功一次

[aofei]

@iGoogle-ink

你好，麻烦你那边帮着测试一下，需要你那边在上述相同的问题环境里将 goproxy.cn 强制解析到 101.71.80.132 这个 IP 地址（比如通过修改 /etc/hosts 等），并测试下连续多次构建看看是否还会出现 429 的情况。

Update: 如果网络条件允许的话，麻烦顺便再额外测试一下 116.0.89.225 这个 IP 地址。

Update 2: 注意确保构建时的 DNS 解析结果符合你的修改，可以通过 dig goproxy.cn 命令验证结果。

[j2gg0s]

101.71.80.132

@aofei

• 看上去可以
• istio 下的那个 dockerfile，不能通过 build 复现问题吗？

[aofei]

• 看上去可以，不过 132 在 shanghai 访问偏慢

这个 101.71.80.132 是我们已经下线没在用的 CDN 线路的节点，拿它出来只是为了测试一下看是不是我们现在的 CDN 线路出现了什么问题。

• istio 下的那个 dockerfile，不能通过 build 复现问题吗？

我这里并不能复现 429 问题，即使大量并发请求也没有复现。

[Suozz]

429 Too Many Requests

有时候好，有时候不好，概率性问题，但是概率还挺大的

我这里 100% 失败

如果 CDN 日志 API 返回的结果没错，今天截止目前为止总共出现过 268 条 429 响应，占比还是非常小的，不过这依旧是一个会导致 CI/CD 等自动构建机制失败的致命错误，我们正在排查当中。

Update (2022-08-25 11:58:47): 根据 CDN 日志反映，最近 30 天内，最早的一条 429 响应出现在 2022-08-24 21:30:48，截止目前共出现过 363 条。

和我的时间点对上了，我从昨天9:30开始就编译不了

[aofei]

@Suozz

那麻烦你那边也分别测试一下 https://github.com/goproxy/goproxy.cn/issues/150#issuecomment-1226769784 这里提到的两个 IP，看是否还会出现 429 问题。

[yhxjack]

在 2022-08

我这里测试了132,403，是不是要带端口

[Suozz]

@Suozz

那麻烦你那边也分别测试一下 #150 (comment) 这里提到的两个 IP，看是否还会出现 429 问题。

测试了 101 的ip ，还是同样的报错

[aofei]

@Suozz 需要注意解析是否生效。

@yhxjack 我指的是将 goproxy.cn 的 DNS 解析结果强制修改到那个 IP，而不是直接访问那个 IP。

[Suozz]

我这里恢复了。

[yhxjack]

我这里也恢复了，是什么问题呢@aofei

[aofei]

我们这边并没有找到具体原因，实际上根据 CDN 日志报告来看今天截止目前也只出现了 415 条 429 响应而已，相比总请求数来说 429 占比是极奇小的。不过还是需要着手排查一下是否是 CDN 线路方面的问题，因为相应时段产生的 429 响应所对应的请求并没有触及我们的后端服务器，也就是说 429 似乎是 CDN 节点单方面抛出的，这就很奇怪了，我们还需要进一步排查，后续有情况我会更新到这里。

[yhxjack]

我们这边并没有找到具体原因，实际上根据 CDN 日志报告来看今天截止目前也只出现了 415 条 429 响应而已，相比总请求数来说 429 占比是极奇小的。不过还是需要着手排查一下是否是 CDN 线路方面的问题，因为相应时段产生的 429 响应所对应的请求并没有触及我们的后端服务器，也就是说 429 似乎是 CDN 节点单方面抛出的，这就很奇怪了，我们还需要进一步排查，后续有情况我会更新到这里。

我也是这么感觉的，我今天构建了不下10次，没有一次是成功的，更别说其他人了，最合理的解释就是请求没到proxy