modprox / mp

Private Go Module Proxy
https://modprox.org
BSD 3-Clause "New" or "Revised" License
16 stars 1 forks source link

proxy: mysql zip store 'max_allowed_packet' bytes errors #152

Closed shoenig closed 5 years ago

shoenig commented 5 years ago
2019/06/28 14:42:49 TRACE [proxy-client] making zip proxy request to https://proxy.golang.org/contrib.go.opencensus.io/exporter/stackdriver/@v/v0.11.0.zip
2019/06/28 14:42:50 INFO  [downloader] downloaded upstream blob of size: 5412109
2019/06/28 14:42:50 ERROR [store] failed to write zip for (contrib.go.opencensus.io/exporter/stackdriver @ v0.11.0), Error 1105: Parameter of prepared statement which is set through mysql_send_long_data() is longer than 'max_allowed_packet' bytes

Hopefully a MySQL client setting

shoenig commented 5 years ago

by setting

command: --max_allowed_packet=4194304

in the mysql-proxy docker-compose service definition, this large package (> 5MB) works now

2019/06/28 16:55:47 TRACE [proxy-client] making zip proxy request to https://proxy.golang.org/contrib.go.opencensus.io/exporter/stackdriver/@v/v0.11.0.zip
2019/06/28 16:55:48 INFO  [downloader] downloaded upstream blob of size: 5412109
2019/06/28 16:55:48 TRACE [store] put module zip (contrib.go.opencensus.io/exporter/stackdriver @ v0.11.0)
2019/06/28 16:55:48 TRACE [store] adding module (contrib.go.opencensus.io/exporter/stackdriver @ v0.11.0)
2019/06/28 16:55:48 TRACE [downloader] stored (contrib.go.opencensus.io/exporter/stackdriver @ v0.11.0), was 5412109 bytes
2019/06/28 16:55:48 TRACE [bg-worker] downloaded (contrib.go.opencensus.io/exporter/stackdriver @ v0.11.0)!
shoenig commented 5 years ago

/sigh there's always a bigger fish.

2019/06/28 17:00:58 TRACE [proxy-client] making zip proxy request to https://proxy.golang.org/github.com/%21azure/azure-sdk-for-go/@v/v21.3.0+incompatible.zip
2019/06/28 17:01:01 INFO  [downloader] downloaded upstream blob of size: 20386124
2019/06/28 17:01:01 TRACE [store] put module zip (github.com/Azure/azure-sdk-for-go @ v21.3.0+incompatible)
2019/06/28 17:01:01 ERROR [store] failed to write zip for (github.com/Azure/azure-sdk-for-go @ v21.3.0+incompatible), Error 1105: Parameter of prepared statement which is set through mysql_send_long_data() is longer than 'max_allowed_packet' bytes
shoenig commented 5 years ago

Now using longblob and allowing 128MiB packets on the mysql driver

# allow up to 128 MiB blobs over the connection
command: --max_allowed_packet=134217728

Seems to work

2019/07/01 11:00:56 INFO  [downloader] going to download from proxy: (github.com/Azure/azure-sdk-for-go @ v21.3.0+incompatible)
2019/07/01 11:00:56 TRACE [proxy-client] making zip proxy request to https://proxy.golang.org/github.com/%21azure/azure-sdk-for-go/@v/v21.3.0+incompatible.zip
2019/07/01 11:00:59 INFO  [downloader] downloaded upstream blob of size: 20386124
2019/07/01 11:00:59 TRACE [store] put module zip (github.com/Azure/azure-sdk-for-go @ v21.3.0+incompatible)
2019/07/01 11:00:59 TRACE [store] adding module (github.com/Azure/azure-sdk-for-go @ v21.3.0+incompatible)
2019/07/01 11:00:59 TRACE [downloader] stored (github.com/Azure/azure-sdk-for-go @ v21.3.0+incompatible), was 20386124 bytes
2019/07/01 11:00:59 TRACE [bg-worker] downloaded (github.com/Azure/azure-sdk-for-go @ v21.3.0+incompatible)!