Blockdaemon / solana-cluster

Tooling to manage Solana snapshots
Apache License 2.0
8 stars 6 forks source link

Mirror fails to upload #197

Open Lusitaniae opened 1 month ago

Lusitaniae commented 1 month ago

solana-cluster mirror --s3-bucket <name> --s3-url https://<endpoint> --tracker http://<consul>:8458
2024-07-24T04:20:18.021Z    INFO    uploader    Worker starting
2024-07-24T04:20:49.782Z    INFO    uploader    Starting upload {"snapshot": "snapshot-279326953-7gyCSaKNmStGcJsSJuHjnL2gn8iXr8EnTCGh84RbBYuB.tar.zst"}
2024-07-24T04:20:49.782Z    INFO    uploader.fetch  Downloading snapshot    {"snapshot": "snapshot-279326953-7gyCSaKNmStGcJsSJuHjnL2gn8iXr8EnTCGh84RbBYuB.tar.zst", "snapshot_url": "http://http://<node1>:13080/v1/snapshot/snapshot-279326953-7gyCSaKNmStGcJsSJuHjnL2gn8iXr8EnTCGh84RbBYuB.tar.zst"}
2024-07-24T04:20:49.851Z    INFO    uploader    Starting upload {"snapshot": "incremental-snapshot-279326953-279334922-7ydR3cDmbZ7X2dN8VU5egSyZ49JZUbsw9AkSmZZCGidU.tar.zst"}
2024-07-24T04:20:49.851Z    INFO    uploader.fetch  Downloading snapshot    {"snapshot": "incremental-snapshot-279326953-279334922-7ydR3cDmbZ7X2dN8VU5egSyZ49JZUbsw9AkSmZZCGidU.tar.zst", "snapshot_url": "http://http://<node1>:13080/v1/snapshot/incremental-snapshot-279326953-279334922-7ydR3cDmbZ7X2dN8VU5egSyZ49JZUbsw9AkSmZZCGidU.tar.zst"}
2024-07-24T04:20:49.859Z    ERROR   uploader    Upload failed   {"snapshot": "snapshot-279326953-7gyCSaKNmStGcJsSJuHjnL2gn8iXr8EnTCGh84RbBYuB.tar.zst", "error": "Get \"http://http//<node1>:13080/v1/snapshot/snapshot-279326953-7gyCSaKNmStGcJsSJuHjnL2gn8iXr8EnTCGh84RbBYuB.tar.zst\": dial tcp: lookup http on 127.0.0.1:53: no such host", "upload_duration": "77.064646ms"}

Removing the hardecoded protocol here seems to fix it

https://github.com/Blockdaemon/solana-cluster/blob/main/internal/mirror/mirror.go#L83

nyetwurk commented 1 month ago

does

    target:  src.Target

work?

Lusitaniae commented 1 month ago

yes, but I hit another error as I was trying to use Cloudflare R2 and had an error that it doesn't support CRC32C