filecoin-project / filecoin-chain-archiver

Filecoin snapshot / chain export software
Other
5 stars 3 forks source link

Reports of Download Failures from South Korea #77

Open ognots opened 1 year ago

ognots commented 1 year ago

Numerous Lotus users out of South Korea have reported issues downloading snapshots. Investigate any potential R2 issues.

4 days ago

Error when downloading lightweight snapshot.
  [ERROR] CUID#7 - Download aborted. URI=https://snapshots.mainnet.filops.net/minimal/latest.zst
Exception: [AbstractCommand.cc:856] errorCode=1 Failed to establish connection, cause: Connection refused
GlacierWalrus commented 1 year ago

I've just completed a successful download using aria2 to an instance in South Korea. I think we'll need more user input to conduct further investigations

 *** Download Progress Summary as of Thu Jul 13 23:51:10 2023 ***                                                                                                                                  
===================================================================================================================================================================================================
[#c7f01b 48GiB/49GiB(97%) CN:4 DL:29MiB ETA:45s]
FILE: /home/ubuntu/aria2c/3032400_2023_07_13T20_00_00Z.car.zst
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

[#c7f01b 49GiB/49GiB(99%) CN:1 DL:24MiB]                                                                                                                                                           
07/13 23:51:58 [NOTICE] Download complete: /home/ubuntu/aria2c/3032400_2023_07_13T20_00_00Z.car.zst

Download Results:
gid   |stat|avg speed  |path/URI
======+====+===========+=======================================================
c7f01b|OK  |    29MiB/s|/home/ubuntu/aria2c/3032400_2023_07_13T20_00_00Z.car.zst

Status Legend:
(OK):download completed.

Aria version:

ubuntu@ip-172-31-3-112:~/aria2c$ aria2c --version
aria2 version 1.36.0
Copyright (C) 2006, 2019 Tatsuhiro Tsujikawa

This program is free software; you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or
(at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

** Configuration **
Enabled Features: Async DNS, BitTorrent, Firefox3 Cookie, GZip, HTTPS, Message Digest, Metalink, XML-RPC, SFTP
Hash Algorithms: sha-1, sha-224, sha-256, sha-384, sha-512, md5, adler32
Libraries: zlib/1.2.11 libxml2/2.9.12 sqlite3/3.36.0 GnuTLS/3.7.1 nettle GMP/6.2.1 c-ares/1.17.1 libssh2/1.10.0
Compiler: gcc 11.2.0
  built by  x86_64-pc-linux-gnu
  on        Aug 21 2021 15:26:28
System: Linux 5.19.0-1025-aws #26~22.04.1-Ubuntu SMP Mon Apr 24 01:58:15 UTC 2023 x86_64

Report bugs to https://github.com/aria2/aria2/issues
Visit https://aria2.github.io/
ognots commented 1 year ago

we've recently been made aware that South Korea is blocking CloudFlare DNS. See https://community.cloudflare.com/t/south-korean-government-blocked-cloudflare-r2/559661/13 This is definitely aggravating the situation, if not totally explaining it. Implementing a custom domain should solve this problem entirely, in other countries, as well