search

pypa / bandersnatch

A PyPI mirror client according to PEP 381 http://www.python.org/dev/peps/pep-0381/
Academic Free License v3.0
455 stars 141 forks source link

Docker running + storing packages on an overlayfs causing conflicting exceptions #1271

Closed tibeer closed 1 year ago

tibeer commented 2 years ago

Description

I want to mirror only a handful of packages with bandersnatch. To achieve this I use a docker-compose file which loads the preset configuration as shown below. After issuing the command below I get a couple of traces of different nature:

Is this expected behaviour and can I ignore the errors safely?

Log output

user@machine pip % docker exec -it pip-bandersnatch-1 bandersnatch -c /conf/bandersnatch.conf 
mirror
2022-11-07 11:00:48,862 INFO: Selected storage backend: filesystem (configuration.py:131)
2022-11-07 11:00:48,864 INFO: Selected compare method: hash (configuration.py:177)
2022-11-07 11:00:49,537 INFO: Initialized project plugin allowlist_project, filtering ['typer', 'docker', 'fastapi'] (allowlist_name.py:31)
2022-11-07 11:00:49,621 INFO: Initialized release plugin allowlist_release, filtering [<Requirement('docker[all]')>, <Requirement('typer[all]')>, <Requirement('fastapi[all]')>] (allowlist_name.py:177)
2022-11-07 11:00:49,699 INFO: Status file /srv/pypi/status missing. Starting over. (mirror.py:566)
2022-11-07 11:00:49,700 INFO: Syncing with https://pypi.org. (mirror.py:57)
2022-11-07 11:00:49,700 INFO: Current mirror serial: 0 (mirror.py:278)
2022-11-07 11:00:49,700 INFO: Syncing all packages. (mirror.py:293)
2022-11-07 11:01:17,621 INFO: Package 'typer' is allowlisted (allowlist_name.py:88)
2022-11-07 11:01:17,946 INFO: Package 'fastapi' is allowlisted (allowlist_name.py:88)
2022-11-07 11:01:17,952 INFO: Package 'docker' is allowlisted (allowlist_name.py:88)
2022-11-07 11:01:24,487 INFO: Trying to reach serial: 15683776 (mirror.py:310)
2022-11-07 11:01:24,487 INFO: 3 packages to sync. (mirror.py:312)
2022-11-07 11:01:24,530 INFO: No metadata filters are enabled. Skipping metadata filtering (mirror.py:76)
2022-11-07 11:01:24,531 INFO: No release file filters are enabled. Skipping release file filtering (mirror.py:80)
2022-11-07 11:01:24,533 INFO: Fetching metadata for package: docker (serial 15631690) (package.py:58)
2022-11-07 11:01:24,536 INFO: Fetching metadata for package: fastapi (serial 15646760) (package.py:58)
2022-11-07 11:01:24,539 INFO: Fetching metadata for package: typer (serial 15668790) (package.py:58)
2022-11-07 11:01:27,253 INFO: Storing index page(s): typer - in /srv/pypi/web/simple/typer (mirror.py:698)
2022-11-07 11:01:31,154 INFO: Storing index page(s): docker - in /srv/pypi/web/simple/docker (mirror.py:698)
2022-11-07 11:01:36,188 INFO: Downloading: https://files.pythonhosted.org/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3/fastapi-0.18.0.tar.gz (mirror.py:875)
2022-11-07 11:01:37,381 INFO: Downloading: https://files.pythonhosted.org/packages/a7/2d/97d6367bec2367b586349e9a35cfa8e269a41a110e5c7910759709854b4a/fastapi-0.19.0.tar.gz (mirror.py:875)
2022-11-07 11:01:38,489 INFO: Downloading: https://files.pythonhosted.org/packages/fc/1f/eab23d52f245e3b09aee2ae85e2507a0f4a56f7ec562698fad9e88b895cb/fastapi-0.2.0.tar.gz (mirror.py:875)
2022-11-07 11:01:39,291 INFO: Downloading: https://files.pythonhosted.org/packages/e6/a3/bffda6970d7153cb519968e3b41275365f190327345073bbbc7ff20d9140/fastapi-0.2.1.tar.gz (mirror.py:875)
2022-11-07 11:01:40,160 INFO: Downloading: https://files.pythonhosted.org/packages/c8/37/9931d412ba3132f2c4332682e0b8bb8ddc0f60471e0a8d6896fa45c73f1c/fastapi-0.20.0.tar.gz (mirror.py:875)
2022-11-07 11:01:41,238 INFO: Downloading: https://files.pythonhosted.org/packages/ba/9a/c1a0504028822ec649a45b52dce11d25b60d7a4b93510a39c9e41435fdc2/fastapi-0.20.1.tar.gz (mirror.py:875)
2022-11-07 11:01:42,337 INFO: Downloading: https://files.pythonhosted.org/packages/52/46/76fc59fd9b472efbc6b00a537b061c22db8ee2b249e87a1ee5c8e9eff306/fastapi-0.21.0.tar.gz (mirror.py:875)
2022-11-07 11:01:43,406 INFO: Downloading: https://files.pythonhosted.org/packages/2c/1d/bcf27e8f99a716cc60dfc9c1258d90d82f05b6c650d2c768eb2ae71d9b63/fastapi-0.22.0.tar.gz (mirror.py:875)
2022-11-07 11:01:44,476 INFO: Downloading: https://files.pythonhosted.org/packages/5e/58/3eeecfc9acb2a5d79b4b523d6cc6f97f122a5ead5ad366f01e750036a74e/fastapi-0.23.0.tar.gz (mirror.py:875)
2022-11-07 11:01:45,535 INFO: Downloading: https://files.pythonhosted.org/packages/71/48/64f0a29bd601a90e323562547a6989db221ad5f69c77e0b7565f8ec477d0/fastapi-0.24.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:01:45,550 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/71/48/64f0a29bd601a90e323562547a6989db221ad5f69c77e0b7565f8ec477d0/fastapi-0.24.0-py3-none-any.whl (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/71/48/64f0a29bd601a90e323562547a6989db221ad5f69c77e0b7565f8ec477d0'
2022-11-07 11:01:45,555 INFO: Downloading: https://files.pythonhosted.org/packages/9c/85/d38aa42a29231906bb559cca8bb2f032f170bfbf647fe446bc90258294ba/fastapi-0.24.0.tar.gz (mirror.py:875)
2022-11-07 11:01:46,654 INFO: Downloading: https://files.pythonhosted.org/packages/b7/48/6a691a87c3eb8638e2e6adb8e1a0e34d35067122a63db29e8c2b435ff3e0/fastapi-0.25.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:01:46,738 INFO: Downloading: https://files.pythonhosted.org/packages/50/16/a7b8f7cdb679e8f81547e0f9d6d9049815a5cbf187738a60be6e682e0089/fastapi-0.25.0.tar.gz (mirror.py:875)
2022-11-07 11:01:47,898 INFO: Downloading: https://files.pythonhosted.org/packages/ad/df/6d757dab8ea480be15f5b600ee90aaf149c16a3780b8cd50bc749f65fdf1/fastapi-0.26.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:01:47,984 INFO: Downloading: https://files.pythonhosted.org/packages/db/a2/8683239773f12c1f97ffd2d76223882a5ecd86abfabc45ceb078d1b668f2/fastapi-0.26.0.tar.gz (mirror.py:875)
2022-11-07 11:01:49,097 INFO: Downloading: https://files.pythonhosted.org/packages/c3/fb/2af84a2e65f5453561c4cc4f571aa282dc8780df2a212fd17951aadddca4/fastapi-0.27.0.tar.gz (mirror.py:875)
2022-11-07 11:01:50,183 INFO: Downloading: https://files.pythonhosted.org/packages/eb/36/31d0a08c3303a4f56494f489d615f49c13603579c6ed49b301f21b711a9b/fastapi-0.27.1.tar.gz (mirror.py:875)
2022-11-07 11:01:51,287 INFO: Downloading: https://files.pythonhosted.org/packages/48/6a/78cecd90b1fc4e62408a53ae4e6de1daa21762c0e1f251fb8a26e2ad061b/fastapi-0.27.2.tar.gz (mirror.py:875)
2022-11-07 11:01:52,401 INFO: Downloading: https://files.pythonhosted.org/packages/e6/b1/cec35fe22b1f15afabf5d02f7b3c3885dacf6cc5364f14ffa58da7febfbc/fastapi-0.28.0.tar.gz (mirror.py:875)
2022-11-07 11:01:53,491 INFO: Downloading: https://files.pythonhosted.org/packages/fb/2a/32279b88584b345333581974843820d0bb8a8ecf956b065a013138362a59/fastapi-0.29.0.tar.gz (mirror.py:875)
2022-11-07 11:01:54,609 INFO: Downloading: https://files.pythonhosted.org/packages/6c/6a/6bca3022a045066fa2e64eca6b64a6ddc1fe6e2b753fc39128b46df6678b/fastapi-0.29.1.tar.gz (mirror.py:875)
2022-11-07 11:01:55,715 INFO: Downloading: https://files.pythonhosted.org/packages/3e/5a/bd109788bf5c76661511bc51ac1c3b67f5040f9579ebc10bd31559f5e5f9/fastapi-0.3.0.tar.gz (mirror.py:875)
2022-11-07 11:01:56,528 INFO: Downloading: https://files.pythonhosted.org/packages/3c/16/f389a874e9a1235227c1c20e709c5503a0621195796286492599d7bd87df/fastapi-0.30.0.tar.gz (mirror.py:875)
2022-11-07 11:01:57,661 INFO: Downloading: https://files.pythonhosted.org/packages/f9/f3/6ecd806db796606431a78de4eff9edcf42f788ff653e9acf4c7f6057c38f/fastapi-0.30.1.tar.gz (mirror.py:875)
2022-11-07 11:01:58,742 INFO: Downloading: https://files.pythonhosted.org/packages/85/69/739de0af8f8db61d9cc1367048eca6c5d161e8869eeed6c9bfcb7434ef6c/fastapi-0.31.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:01:58,857 INFO: Downloading: https://files.pythonhosted.org/packages/3d/4e/7ea13b3e4c0590b57d8138041cfb511dd2b450f97316f138951348851dc0/fastapi-0.31.0.tar.gz (mirror.py:875)
2022-11-07 11:01:59,948 INFO: Downloading: https://files.pythonhosted.org/packages/2c/da/9f1ee461ce48e34b2accd0cbb45d3c527049508e965ace846a48c83957d2/fastapi-0.32.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:00,025 INFO: Downloading: https://files.pythonhosted.org/packages/d1/ce/2e59c0404fce6237d2fc99df0858459ea605238d16e45720a64824f8851c/fastapi-0.32.0.tar.gz (mirror.py:875)
2022-11-07 11:02:01,272 INFO: Downloading: https://files.pythonhosted.org/packages/94/01/9fdade622c17ebe2f24dd32df87ae8cd69dc5d6046eb2fec5f5a9c6fdefe/fastapi-0.33.0.tar.gz (mirror.py:875)
2022-11-07 11:02:02,468 INFO: Downloading: https://files.pythonhosted.org/packages/45/9e/483c79a63ca3062cc844442b1e88293dcf524ca724742538f036e617dca1/fastapi-0.34.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:02,561 INFO: Downloading: https://files.pythonhosted.org/packages/d8/bd/b4083b9f38a3f62dbb3dca2d7094d5941efdbff39ca1b57da3364da0dfb1/fastapi-0.34.0.tar.gz (mirror.py:875)
2022-11-07 11:02:03,683 INFO: Downloading: https://files.pythonhosted.org/packages/07/b7/ebc45989b2c7bfca3b49a579ad38d0011ba3054ce4a6666278933145a1dd/fastapi-0.35.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:03,779 INFO: Downloading: https://files.pythonhosted.org/packages/67/35/259ef7a337036fbe21be0748515481f0f7dd328100db27c7e3e2acebbe8d/fastapi-0.35.0.tar.gz (mirror.py:875)
2022-11-07 11:02:04,905 INFO: Downloading: https://files.pythonhosted.org/packages/bb/94/7b5953d610858b0d0324b849e13cdf97bef476a27d8d8ca3494c35a6eb54/fastapi-0.36.0.tar.gz (mirror.py:875)
2022-11-07 11:02:06,041 INFO: Downloading: https://files.pythonhosted.org/packages/34/12/093fe39888016473561d302327a013301a4ca8b9509c7a6b9af26aecfdd0/fastapi-0.37.0.tar.gz (mirror.py:875)
2022-11-07 11:02:07,144 INFO: Downloading: https://files.pythonhosted.org/packages/1b/f5/595bb169d0d85f7d3811fcf268c0872a05cb48cdd1ac1e0a14b063de3972/fastapi-0.38.0.tar.gz (mirror.py:875)
2022-11-07 11:02:08,258 INFO: Downloading: https://files.pythonhosted.org/packages/af/63/76229a4268091757dfce3f63487e8c9b92639c30a8396757679e3a20c6b6/fastapi-0.38.1.tar.gz (mirror.py:875)
2022-11-07 11:02:09,404 INFO: Downloading: https://files.pythonhosted.org/packages/8b/20/eb050de401ef0a302f20452e123af841af47306b034f9044c279ae5b37d3/fastapi-0.39.0.tar.gz (mirror.py:875)
2022-11-07 11:02:10,491 INFO: Downloading: https://files.pythonhosted.org/packages/8c/65/12ba1e298bca05dc2109f96c35c4a54c5aeadeb81e9fd88ebbead9cb7bdd/fastapi-0.4.0.tar.gz (mirror.py:875)
2022-11-07 11:02:11,416 INFO: Downloading: https://files.pythonhosted.org/packages/c4/cd/685523fc953335ac62dd4ceb9347994a85b768d2b32d1d829ce82e8048dd/fastapi-0.40.0.tar.gz (mirror.py:875)
2022-11-07 11:02:12,550 INFO: Downloading: https://files.pythonhosted.org/packages/6e/31/5f3b44f0f572c523e78a05bf2bca155466b95e4746ad5a4d500736b86f9c/fastapi-0.41.0.tar.gz (mirror.py:875)
2022-11-07 11:02:13,667 INFO: Downloading: https://files.pythonhosted.org/packages/90/31/099a3abb5d43db1a0fc29144e4dd8681ca33a6005473fd315ff364c6e5c6/fastapi-0.42.0.tar.gz (mirror.py:875)
2022-11-07 11:02:14,783 INFO: Downloading: https://files.pythonhosted.org/packages/b9/73/c59aca57ed410d531ca31cda428c6e03c1c07bdc466cd3b5d3dbebc5fdfc/fastapi-0.43.0.tar.gz (mirror.py:875)
2022-11-07 11:02:15,881 INFO: Downloading: https://files.pythonhosted.org/packages/ea/24/d65623a36f970764797edb4b4bbe8d9166f4911a28371410d01bd6ef0cd6/fastapi-0.44.0.tar.gz (mirror.py:875)
2022-11-07 11:02:16,994 INFO: Downloading: https://files.pythonhosted.org/packages/66/9e/cf4837c3cc4d96caddf97a2974c8bb02204ffae7fc9c0ceaff9c21cf3c49/fastapi-0.44.1.tar.gz (mirror.py:875)
2022-11-07 11:02:18,553 INFO: Downloading: https://files.pythonhosted.org/packages/6b/f4/8aa81e9e5de3877a3149f7e53b21cc3de28d2a474692f17b79b6baf1deb8/fastapi-0.45.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:18,613 INFO: Downloading: https://files.pythonhosted.org/packages/ce/eb/93adebcaf0ddddc4d185520d6bad5c00d2b3b5f70abe15ac16555e3a5b50/fastapi-0.45.0.tar.gz (mirror.py:875)
2022-11-07 11:02:19,850 INFO: Downloading: https://files.pythonhosted.org/packages/7b/c4/3593af517fbdeb51443d8376f2cbe3c63cb46531aa66415516251119a398/fastapi-0.46.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:19,914 INFO: Downloading: https://files.pythonhosted.org/packages/b4/cc/44941903f220aad11f7252d729dc32a7cb2ec20d4ffd78053abea4a4d050/fastapi-0.46.0.tar.gz (mirror.py:875)
2022-11-07 11:02:21,087 INFO: Downloading: https://files.pythonhosted.org/packages/c7/67/d489088f26e9d4846043cc15160dcabba117474ee6b76c7db7fb215f7c71/fastapi-0.47.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:21,152 INFO: Downloading: https://files.pythonhosted.org/packages/de/b1/cca52dc8e2bbf91d4e411bc87f3160cc5f6856e75a9e0b081fef25bc77ac/fastapi-0.47.0.tar.gz (mirror.py:875)
2022-11-07 11:02:22,338 INFO: Downloading: https://files.pythonhosted.org/packages/a3/a7/4804d7abf8a1544d079d50650af872387154ebdac5bd07d54b2e60e2b334/fastapi-0.47.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:22,345 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/a3/a7/4804d7abf8a1544d079d50650af872387154ebdac5bd07d54b2e60e2b334/fastapi-0.47.1-py3-none-any.whl (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/a3/a7/4804d7abf8a1544d079d50650af872387154ebdac5bd07d54b2e60e2b334'
2022-11-07 11:02:22,349 INFO: Downloading: https://files.pythonhosted.org/packages/24/98/4fc080a7caafd79deb3abdd899be45337e78e6768aba08678aee7c4edfc3/fastapi-0.47.1.tar.gz (mirror.py:875)
2022-11-07 11:02:23,516 INFO: Downloading: https://files.pythonhosted.org/packages/7b/1a/c53cf201d35cc1bb69fd2f5af9976cb12c2f0156c4662d61ce5c22c76ded/fastapi-0.48.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:23,567 INFO: Downloading: https://files.pythonhosted.org/packages/37/d9/679462f5d48458afc8afcc3c8cc62177843aaafb416162666c3fa7b162f3/fastapi-0.48.0.tar.gz (mirror.py:875)
2022-11-07 11:02:24,753 INFO: Downloading: https://files.pythonhosted.org/packages/b4/0c/d7ce15c837486502ae146aec1caab3515d6fa434ae2554d88e3d589f180a/fastapi-0.49.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:24,800 INFO: Downloading: https://files.pythonhosted.org/packages/10/7e/691edfb8fc0bc7f201be0dcd92f58836a57abffe3dee10d24adb301c6da7/fastapi-0.49.0.tar.gz (mirror.py:875)
2022-11-07 11:02:25,920 INFO: Downloading: https://files.pythonhosted.org/packages/2f/57/ad36eb7f47c463e3bf5ec57874c14469b6065b1ab2d510f7b2b4219f9148/fastapi-0.49.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:26,002 INFO: Downloading: https://files.pythonhosted.org/packages/db/fd/3d6b6a70892784f7bfba11a3755d7271613d0f0db438dfb4b001f39f21d0/fastapi-0.49.1.tar.gz (mirror.py:875)
2022-11-07 11:02:27,202 INFO: Downloading: https://files.pythonhosted.org/packages/b8/2a/13ca48d28a51ebad2f0e12f9084252ac02d60e7c207737c5fae5d1639d0e/fastapi-0.49.2-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:27,213 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/b8/2a/13ca48d28a51ebad2f0e12f9084252ac02d60e7c207737c5fae5d1639d0e/fastapi-0.49.2-py3-none-any.whl (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/b8/2a/13ca48d28a51ebad2f0e12f9084252ac02d60e7c207737c5fae5d1639d0e'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/b8/2a/13ca48d28a51ebad2f0e12f9084252ac02d60e7c207737c5fae5d1639d0e'
2022-11-07 11:02:27,217 INFO: Downloading: https://files.pythonhosted.org/packages/c7/97/b0fc25252a3d74c27e392505660ed1d9e36f116a2783dfccd692c759c3b3/fastapi-0.49.2.tar.gz (mirror.py:875)
2022-11-07 11:02:28,463 INFO: Downloading: https://files.pythonhosted.org/packages/c3/31/127290b5be5e72423e8937506830964b50e818a2039db3ec1d46b0abade7/fastapi-0.5.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:28,540 INFO: Downloading: https://files.pythonhosted.org/packages/e4/27/eb1e323b2eb60dab88d93ec6dae4f76970b1e441a70d8573e030ae0da02c/fastapi-0.5.0.tar.gz (mirror.py:875)
2022-11-07 11:02:29,423 INFO: Downloading: https://files.pythonhosted.org/packages/62/20/6f9895adaf7a5c9005eed6c6a6855bf0a39507037b03571dc9285ce16af1/fastapi-0.5.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:29,500 INFO: Downloading: https://files.pythonhosted.org/packages/3e/08/1ac8eda55669cd5c2b2fd343ee81e460cf6a24f49368fd7de28c0c0a6023/fastapi-0.5.1.tar.gz (mirror.py:875)
2022-11-07 11:02:29,514 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/3e/08/1ac8eda55669cd5c2b2fd343ee81e460cf6a24f49368fd7de28c0c0a6023/fastapi-0.5.1.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/3e/08/1ac8eda55669cd5c2b2fd343ee81e460cf6a24f49368fd7de28c0c0a6023'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/3e/08/1ac8eda55669cd5c2b2fd343ee81e460cf6a24f49368fd7de28c0c0a6023'
2022-11-07 11:02:29,523 INFO: Downloading: https://files.pythonhosted.org/packages/91/56/20f373a15e83e429fbbbf5e09357dde46cb9171f89e76e0ee3eaf4fc3578/fastapi-0.50.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:29,627 INFO: Downloading: https://files.pythonhosted.org/packages/82/fd/f967d9845c85d475e1a3fe228ae72b04e0dcb615638b8b2e10f794f825ff/fastapi-0.50.0.tar.gz (mirror.py:875)
2022-11-07 11:02:30,826 INFO: Downloading: https://files.pythonhosted.org/packages/e7/dc/930093c07ef0ce8fa960139bbbc6cf0b2b4343c5b0faf4222e2e7afa826a/fastapi-0.51.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:30,897 INFO: Downloading: https://files.pythonhosted.org/packages/d8/a4/a192938c358ba12043fb5f34ef9319d4ba776c53bfc4bd893c0d21fdbd9e/fastapi-0.51.0.tar.gz (mirror.py:875)
2022-11-07 11:02:32,081 INFO: Downloading: https://files.pythonhosted.org/packages/18/5b/46c084c174fc69b2a7e1d9c22d014f39fb677d9a7635f24734ef56e0fb53/fastapi-0.52.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:32,144 INFO: Downloading: https://files.pythonhosted.org/packages/7f/3a/d19b7af86f61877c2d976b3b220ae8b2b22c45fa8f0d0787e9f32d40fcc2/fastapi-0.52.0.tar.gz (mirror.py:875)
2022-11-07 11:02:33,328 INFO: Downloading: https://files.pythonhosted.org/packages/f9/eb/f899ccd1f052bb306d3938696458a403ee61a116fd784bc9fb266f6ce211/fastapi-0.53.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:33,401 INFO: Downloading: https://files.pythonhosted.org/packages/ee/fa/a9bdf3410669cb2f10e9fe4e11d1ae13338ed7947745e8b3797a6bff5c8a/fastapi-0.53.0.tar.gz (mirror.py:875)
2022-11-07 11:02:34,567 INFO: Downloading: https://files.pythonhosted.org/packages/cb/19/5bb41e0f33413cf768a63451945a2166ca76c14d4a42f79c7b628d7bfaae/fastapi-0.53.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:34,632 INFO: Downloading: https://files.pythonhosted.org/packages/fd/1c/752cee1610bea575e60fa975ff3d5b535ede94a7742da6f43b9b5c3f6da8/fastapi-0.53.1.tar.gz (mirror.py:875)
2022-11-07 11:02:35,814 INFO: Downloading: https://files.pythonhosted.org/packages/f7/6b/d7c462d6dbf9460981389b02045bdf730f55e079c3497f197db44fef14e4/fastapi-0.53.2-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:35,881 INFO: Downloading: https://files.pythonhosted.org/packages/e3/aa/d807237eca90e3a1f49139407eda6d7a380a77a6747b1c37265bf7ecf43f/fastapi-0.53.2.tar.gz (mirror.py:875)
2022-11-07 11:02:37,062 INFO: Downloading: https://files.pythonhosted.org/packages/f6/26/fe0ef3f1ba5b0b2264da858a4407ed1fcd94f49655281487e6bd2709a8b7/fastapi-0.54.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:37,130 INFO: Downloading: https://files.pythonhosted.org/packages/f7/b9/6aad3271f8171bc098bf8a184c03d8c376ca6fb6b01a63484d37c17f9f60/fastapi-0.54.0.tar.gz (mirror.py:875)
2022-11-07 11:02:38,333 INFO: Downloading: https://files.pythonhosted.org/packages/f9/45/9c54e719b0625ea13ed921853269ece018dfea9b7a07ddef935bbf716dc9/fastapi-0.54.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:38,391 INFO: Downloading: https://files.pythonhosted.org/packages/4d/54/45770888a4a73666390120b444131568637e70b5e002860bad99fa1dcb27/fastapi-0.54.1.tar.gz (mirror.py:875)
2022-11-07 11:02:39,592 INFO: Downloading: https://files.pythonhosted.org/packages/80/fb/c1109c43c32bac260906e640cfc88e23fba751ba61319af779dd390aaa9b/fastapi-0.54.2-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:39,660 INFO: Downloading: https://files.pythonhosted.org/packages/be/a9/28297b80b3573662af8ae205c162362aa6a5308dc4ba9e381471590d9b96/fastapi-0.54.2.tar.gz (mirror.py:875)
2022-11-07 11:02:40,888 INFO: Downloading: https://files.pythonhosted.org/packages/29/7f/013c7f28edd70f8825d3e95b8d19467a151cd698977a0f0a36a04110475c/fastapi-0.55.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:40,960 INFO: Downloading: https://files.pythonhosted.org/packages/bf/40/37def65cd25fc032e1b555ed8038d62a3d77613a5c47bc03311e1a9859c7/fastapi-0.55.0.tar.gz (mirror.py:875)
2022-11-07 11:02:42,207 INFO: Downloading: https://files.pythonhosted.org/packages/05/24/29cf80ab90b921fc245118762afc67e561b591a6b8b9523f650a2ddf59e5/fastapi-0.55.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:42,269 INFO: Downloading: https://files.pythonhosted.org/packages/0a/13/785d0e5967128628f1d6c05ba16d4c9bf9506d7fd35bbe5b2e269d2804ab/fastapi-0.55.1.tar.gz (mirror.py:875)
2022-11-07 11:02:43,598 INFO: Downloading: https://files.pythonhosted.org/packages/bd/0e/f313c9973973b74aef39397ce2b3e6c8d4e6e0172da43499ea80692d20b8/fastapi-0.56.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:43,653 INFO: Downloading: https://files.pythonhosted.org/packages/bc/81/1caf557ef8e721c45bb77258eb4dfda715f99bc90dbed2d59e66e5a4c545/fastapi-0.56.0.tar.gz (mirror.py:875)
2022-11-07 11:02:44,905 INFO: Downloading: https://files.pythonhosted.org/packages/10/1b/6995baf88eaf291cd20e6b3a9eaab13173746bd39591e9d0faf25db5469b/fastapi-0.56.1.tar.gz (mirror.py:875)
2022-11-07 11:02:46,186 INFO: Downloading: https://files.pythonhosted.org/packages/55/fe/c4f3d3f4056ed63ec0d852746529f05a9afe740c51bdc23ac037042ebc1b/fastapi-0.57.0.tar.gz (mirror.py:875)
2022-11-07 11:02:47,493 INFO: Downloading: https://files.pythonhosted.org/packages/0a/26/754130d8f3c85f56e98758e91bd848d50389f215cf46e5d08689adb1b9ab/fastapi-0.58.0.tar.gz (mirror.py:875)
2022-11-07 11:02:48,765 INFO: Downloading: https://files.pythonhosted.org/packages/b0/47/a46950e883896d0280f13a4dd5b8bef2c72ebe9fd5509e360c19e2d181bf/fastapi-0.58.1.tar.gz (mirror.py:875)
2022-11-07 11:02:50,060 INFO: Downloading: https://files.pythonhosted.org/packages/9f/c2/31ae21414301c60d0bbb83676d843aa303f2e3bc47987cb471438e8b30b6/fastapi-0.59.0.tar.gz (mirror.py:875)
2022-11-07 11:02:51,321 INFO: Downloading: https://files.pythonhosted.org/packages/c9/68/f9606baa28ff12e65a55ffc76d6978f42e41a8166baa5678822d32cc60b7/fastapi-0.6.0.tar.gz (mirror.py:875)
2022-11-07 11:02:52,238 INFO: Downloading: https://files.pythonhosted.org/packages/db/ff/19c04ede806ff37de2a64590daae0d2bf3fda0be2068eb475a258503b217/fastapi-0.6.1.tar.gz (mirror.py:875)
2022-11-07 11:02:53,133 INFO: Downloading: https://files.pythonhosted.org/packages/2c/a4/5be495c24d80e5f0117182a836cd04c10026b38349f386d4ad7d908852e0/fastapi-0.6.2.tar.gz (mirror.py:875)
2022-11-07 11:02:54,027 INFO: Downloading: https://files.pythonhosted.org/packages/52/ef/3f770b61e25e3863fb0199014b1099728a2d6c887bb9bd59f0383e8333b9/fastapi-0.6.3.tar.gz (mirror.py:875)
2022-11-07 11:02:54,916 INFO: Downloading: https://files.pythonhosted.org/packages/5e/36/d6a12c5532a31b072f69674cb55f52c911410a60ef40687f2a9f06bfbc4f/fastapi-0.6.4.tar.gz (mirror.py:875)
2022-11-07 11:02:55,869 INFO: Downloading: https://files.pythonhosted.org/packages/b0/f7/6abe5e057df3afcaa0566903ae8d60ecad64a13599e937254f23b49e7ea2/fastapi-0.60.0.tar.gz (mirror.py:875)
2022-11-07 11:02:57,165 INFO: Downloading: https://files.pythonhosted.org/packages/f7/c8/fa9ef0711be4f38dd8f381ee3e610330aaf5dfe26c880bf18565d7b1753e/fastapi-0.60.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:57,225 INFO: Downloading: https://files.pythonhosted.org/packages/83/08/3d0113f3c4c0ad650ca438d583187af434f7136843c3ed04216866db21d4/fastapi-0.60.1.tar.gz (mirror.py:875)
2022-11-07 11:02:58,504 INFO: Downloading: https://files.pythonhosted.org/packages/30/1a/0346ce8f8146d6f74d91ad15429f8bee32b7eecc500efae401fcd2578acd/fastapi-0.60.2-py3-none-any.whl (mirror.py:875)
2022-11-07 11:02:58,575 INFO: Downloading: https://files.pythonhosted.org/packages/ac/bc/9ec5a7400d02df102d15b53f689993ba491a11b5cfc86c90a4accb019195/fastapi-0.60.2.tar.gz (mirror.py:875)
2022-11-07 11:02:59,967 INFO: Downloading: https://files.pythonhosted.org/packages/ac/af/e10003597b5dd7a98add4b208be133161e0d886db203eca733dbe3b200b2/fastapi-0.61.0.tar.gz (mirror.py:875)
2022-11-07 11:03:01,271 INFO: Downloading: https://files.pythonhosted.org/packages/48/65/454fb440d48098845875b5ba8599efafee1efabb97720a584c78674e6d26/fastapi-0.61.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:01,318 INFO: Downloading: https://files.pythonhosted.org/packages/da/32/ea2b86e56674ff3d1bb0bbb2e3b74a04694ac0be3331e9f9d431c350bcc2/fastapi-0.61.1.tar.gz (mirror.py:875)
2022-11-07 11:03:01,331 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/da/32/ea2b86e56674ff3d1bb0bbb2e3b74a04694ac0be3331e9f9d431c350bcc2/fastapi-0.61.1.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/da/32/ea2b86e56674ff3d1bb0bbb2e3b74a04694ac0be3331e9f9d431c350bcc2'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/da/32/ea2b86e56674ff3d1bb0bbb2e3b74a04694ac0be3331e9f9d431c350bcc2'
2022-11-07 11:03:01,335 INFO: Downloading: https://files.pythonhosted.org/packages/4c/0b/5df17eaadb7fe39dad349f484e551e802ce0581be672822f010c530d5e75/fastapi-0.61.2-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:01,448 INFO: Downloading: https://files.pythonhosted.org/packages/36/0c/888ebd0cdef9045b811c3e06b3860742a41d4b9699ba4e0b81fa82d9d817/fastapi-0.61.2.tar.gz (mirror.py:875)
2022-11-07 11:03:02,922 INFO: Downloading: https://files.pythonhosted.org/packages/09/9b/e45a36554f7452f6d372e607a647c3827434f5b353ef4630a7432514c928/fastapi-0.62.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:03,015 INFO: Downloading: https://files.pythonhosted.org/packages/6a/7c/b694a1e8d0620cfd9ad1f50e64f69f6b1317f55f7583931599ba7d36d2b8/fastapi-0.62.0.tar.gz (mirror.py:875)
2022-11-07 11:03:04,262 INFO: Downloading: https://files.pythonhosted.org/packages/9f/33/1b643f650688ad368983bbaf3b0658438038ea84d775dd37393d826c3833/fastapi-0.63.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:04,364 INFO: Downloading: https://files.pythonhosted.org/packages/7f/5b/23057d0cdeac3643c08937ef1348590e284842636c837108971d8af6b51d/fastapi-0.63.0.tar.gz (mirror.py:875)
2022-11-07 11:03:05,613 INFO: Downloading: https://files.pythonhosted.org/packages/0f/cc/929a628d250bc81ff39aa2a3f8d66b3ea2e07c3c93135e9b0303058ccd59/fastapi-0.64.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:05,688 INFO: Downloading: https://files.pythonhosted.org/packages/a1/fe/064bdb5598ad9dfe942b58884296bcd7b81d1e13e5af48fd328e38b2de97/fastapi-0.64.0.tar.gz (mirror.py:875)
2022-11-07 11:03:07,184 INFO: Downloading: https://files.pythonhosted.org/packages/2c/2a/4b5dcc2eabaa439f81387b0d3f80ebb2ea52b0436720b713fef79db32b7e/fastapi-0.65.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:07,254 INFO: Downloading: https://files.pythonhosted.org/packages/8d/31/eb754cf36c72ad0b46ca3e8de2ceadabfaee85cec74cebe226280c40f1dc/fastapi-0.65.0.tar.gz (mirror.py:875)
2022-11-07 11:03:08,744 INFO: Downloading: https://files.pythonhosted.org/packages/4e/b9/a91a699f5c201413b3f61405dbccc29ebe5ad25945230e9cec98fdb2434c/fastapi-0.65.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:08,824 INFO: Downloading: https://files.pythonhosted.org/packages/3a/e5/5eee1f9204886acb45da099f91bf34985b2c536b2746ef9bc3a937751ff7/fastapi-0.65.1.tar.gz (mirror.py:875)
2022-11-07 11:03:10,327 INFO: Downloading: https://files.pythonhosted.org/packages/dc/a8/a6be420593c4061c086e6d2ba47db46401d9af2b98b6cd33d35284f706d3/fastapi-0.65.2-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:10,398 INFO: Downloading: https://files.pythonhosted.org/packages/8c/5d/66e0777c6702d0f1bc238aca5ef4f8914eb564b27a04c87e158cd26bd69a/fastapi-0.65.2.tar.gz (mirror.py:875)
2022-11-07 11:03:10,414 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/8c/5d/66e0777c6702d0f1bc238aca5ef4f8914eb564b27a04c87e158cd26bd69a/fastapi-0.65.2.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/8c/5d/66e0777c6702d0f1bc238aca5ef4f8914eb564b27a04c87e158cd26bd69a'
2022-11-07 11:03:10,418 INFO: Downloading: https://files.pythonhosted.org/packages/54/d2/1e5d77c3c16dad9582c4c86722c998b12ba7937e68e7e212dca71808626a/fastapi-0.65.3-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:10,536 INFO: Downloading: https://files.pythonhosted.org/packages/59/27/c7402c3e9ba3db1a6e7de187ad9de5d9c3b5ee6582fac43267e0c67f8937/fastapi-0.65.3.tar.gz (mirror.py:875)
2022-11-07 11:03:11,989 INFO: Downloading: https://files.pythonhosted.org/packages/f8/cb/2682d18ac7a553a0203f48190f474ab6dde6cd8815ac6822a46d611e6661/fastapi-0.66.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:12,108 INFO: Downloading: https://files.pythonhosted.org/packages/63/30/c5c72431045f502d523bdf749ce9afa90ee1591426fcdd3db05f216ca8b7/fastapi-0.66.0.tar.gz (mirror.py:875)
2022-11-07 11:03:13,646 INFO: Downloading: https://files.pythonhosted.org/packages/1b/a0/51ad4a441b28f3c3bfa0b864df4c09c9ba54e67e066f39028130fe3beff7/fastapi-0.66.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:13,762 INFO: Downloading: https://files.pythonhosted.org/packages/f3/84/ca8505d899255f00eb5c8b21817b3a77a946b22c0c469f20b54c03fb47e2/fastapi-0.66.1.tar.gz (mirror.py:875)
2022-11-07 11:03:15,369 INFO: Downloading: https://files.pythonhosted.org/packages/52/be/2a26007dc86c51e87d70021f6c1b3442726c5918fe57d27927badf687122/fastapi-0.67.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:15,433 INFO: Downloading: https://files.pythonhosted.org/packages/49/48/26f1b57a5742b364e33ba2908faf794b024658cf26ac340ae692edd4e677/fastapi-0.67.0.tar.gz (mirror.py:875)
2022-11-07 11:03:16,941 INFO: Downloading: https://files.pythonhosted.org/packages/c1/66/5275b973ab5704e47e6735051f30c1e0c827edec2825b84e77cc21c8ba6c/fastapi-0.68.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:17,016 INFO: Downloading: https://files.pythonhosted.org/packages/64/df/939fed987038be2344d1187b666f7ecf172f81d6c9327357ccce05f4e40f/fastapi-0.68.0.tar.gz (mirror.py:875)
2022-11-07 11:03:18,467 INFO: Downloading: https://files.pythonhosted.org/packages/df/44/ee1976b03404318590bbe4b0ef27007ce2c42b15757aa0c72bc99a4ebae7/fastapi-0.68.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:18,541 INFO: Downloading: https://files.pythonhosted.org/packages/e0/2a/03c3e1ede3aa83c45da1d156b0180288e573f5e2643ec4fd6d697cebebdf/fastapi-0.68.1.tar.gz (mirror.py:875)
2022-11-07 11:03:20,089 INFO: Downloading: https://files.pythonhosted.org/packages/92/a8/10d8a171afa66e6e8a5cfe82771d11c4c84a2a874c19c0b55c7099001fac/fastapi-0.68.2-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:20,166 INFO: Downloading: https://files.pythonhosted.org/packages/00/6e/4a1dd8aeb5f673f9b772b64a35e7d11e94057306caf3108d52fd47eac7cf/fastapi-0.68.2.tar.gz (mirror.py:875)
2022-11-07 11:03:21,776 INFO: Downloading: https://files.pythonhosted.org/packages/cc/84/23b7d8b4e0b389d74b8cc5dbd2b40d44e275f1e6d04d547f8ac1f89c2d9c/fastapi-0.69.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:21,846 INFO: Downloading: https://files.pythonhosted.org/packages/c6/51/7b4d02f3936a4693b871b7b7ae41f19f770c850b54cc5d0b0e98b976e51f/fastapi-0.69.0.tar.gz (mirror.py:875)
2022-11-07 11:03:23,694 INFO: Downloading: https://files.pythonhosted.org/packages/e1/2c/009a8c8b5b3a1d03ee0e65d82d0a0e44c4a937c101fa0397efac12a1f4a3/fastapi-0.7.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:23,787 INFO: Downloading: https://files.pythonhosted.org/packages/39/c8/4021029cc8a20d83048ec4f9aff57061508a00043590b76164fdf983c674/fastapi-0.7.0.tar.gz (mirror.py:875)
2022-11-07 11:03:24,804 INFO: Downloading: https://files.pythonhosted.org/packages/a3/d2/1d27313c69cfb998521a476931266d84b7bd59d479f7ea6bfbe2d94d9964/fastapi-0.7.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:24,891 INFO: Downloading: https://files.pythonhosted.org/packages/5c/9f/0a27b476708aa6c47abefe74a2ef5db14205bd5938d736e7aea9e6ff6bd1/fastapi-0.7.1.tar.gz (mirror.py:875)
2022-11-07 11:03:25,905 INFO: Downloading: https://files.pythonhosted.org/packages/72/44/a35678119f8a6b25f12224bc55463ecc813c4a0a2c3546818890a50db482/fastapi-0.70.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:25,978 INFO: Downloading: https://files.pythonhosted.org/packages/e6/35/384bc3bf9a4926a45052037e0bf0806ffeda237b8b731cb04a5e1e1c6a45/fastapi-0.70.0.tar.gz (mirror.py:875)
2022-11-07 11:03:27,848 INFO: Downloading: https://files.pythonhosted.org/packages/90/89/06fe73e915538261626ac4b95b5b8f61938b6150cbed5f9f99c5a16f9719/fastapi-0.70.1.tar.gz (mirror.py:875)
2022-11-07 11:03:29,483 INFO: Downloading: https://files.pythonhosted.org/packages/d7/84/55a906526454816a5d194c8572cb4c4cca8d56f8a1192bf87a9ac101238f/fastapi-0.71.0.tar.gz (mirror.py:875)
2022-11-07 11:03:31,076 INFO: Downloading: https://files.pythonhosted.org/packages/81/da/d3df7f1e153638842a3cf4b1ed0172680d24d6ecd4491ccb8cc132b90778/fastapi-0.72.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:31,085 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/81/da/d3df7f1e153638842a3cf4b1ed0172680d24d6ecd4491ccb8cc132b90778/fastapi-0.72.0-py3-none-any.whl (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/81/da/d3df7f1e153638842a3cf4b1ed0172680d24d6ecd4491ccb8cc132b90778'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/81/da/d3df7f1e153638842a3cf4b1ed0172680d24d6ecd4491ccb8cc132b90778'
2022-11-07 11:03:31,094 INFO: Downloading: https://files.pythonhosted.org/packages/af/d8/34d3939d705060c5a0d714db371cf863568c97f88a059489baa442e79c1a/fastapi-0.72.0.tar.gz (mirror.py:875)
2022-11-07 11:03:32,972 INFO: Downloading: https://files.pythonhosted.org/packages/27/a7/439a8891b22b4f1e45483b8a3b209f2eabcfdd44e75c339d5f2d315342fa/fastapi-0.73.0.tar.gz (mirror.py:875)
2022-11-07 11:03:34,404 INFO: Downloading: https://files.pythonhosted.org/packages/3f/c1/7c8107f72bcee63f61ce2fe9bb6503a0f67a893c63e063e184f592b9c532/fastapi-0.74.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:34,488 INFO: Downloading: https://files.pythonhosted.org/packages/2a/d4/6a88d73df0b26b6b00378efe6bbde410377f0d3338834e6c7115e86e858a/fastapi-0.74.0.tar.gz (mirror.py:875)
2022-11-07 11:03:36,138 INFO: Downloading: https://files.pythonhosted.org/packages/99/e0/ef1628c4aa96b0a1a2c81a3cac501ebd58849516ea6d1d0e4faf87bf3b34/fastapi-0.74.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:36,231 INFO: Downloading: https://files.pythonhosted.org/packages/c8/ce/07fc3196b05948e16fbc46944728218d4af9a7fb6536e74804c26e303eb8/fastapi-0.74.1.tar.gz (mirror.py:875)
2022-11-07 11:03:37,904 INFO: Downloading: https://files.pythonhosted.org/packages/4f/46/226355e82ccb4be82e06269e9a546f16c1d87fbda2286fb5d36a1c31af9e/fastapi-0.75.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:37,973 INFO: Downloading: https://files.pythonhosted.org/packages/6d/0b/64ecaddaa9d6d4bbf40422664650f7ec45de9281306c69f22f16f92c510c/fastapi-0.75.0.tar.gz (mirror.py:875)
2022-11-07 11:03:40,937 INFO: Downloading: https://files.pythonhosted.org/packages/2c/1c/195178dfef05e6688d9201aca157b5b8a23171dfc685450fba138547d465/fastapi-0.75.2.tar.gz (mirror.py:875)
2022-11-07 11:03:42,525 INFO: Downloading: https://files.pythonhosted.org/packages/7f/6d/9986b5ebbef1872885d9bd76e7ce24def372beddfe5d6e98b5ae36f2e46f/fastapi-0.76.0.tar.gz (mirror.py:875)
2022-11-07 11:03:44,421 INFO: Downloading: https://files.pythonhosted.org/packages/db/9e/67413d504b1cc044881e7d181c0206a27dd3534fcf6fdf92443477473986/fastapi-0.77.0.tar.gz (mirror.py:875)
2022-11-07 11:03:46,086 INFO: Downloading: https://files.pythonhosted.org/packages/16/5b/d45cca598cec06bead962b84648cbdb0c0d966f2453694bce6f5ce4c0bc9/fastapi-0.77.1-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:46,146 INFO: Downloading: https://files.pythonhosted.org/packages/eb/ab/bdf0fbdbeb1badc95fd1d6510c575457e53efc23c67021684002200e0aa3/fastapi-0.77.1.tar.gz (mirror.py:875)
2022-11-07 11:03:48,262 INFO: Downloading: https://files.pythonhosted.org/packages/61/0f/427f0af121b226e62237e430f5bf4485e0ae1565b3f5b782613b59f30abc/fastapi-0.78.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:48,325 INFO: Downloading: https://files.pythonhosted.org/packages/b7/2a/4676736c3b1864ca483265db43cad9710b83a95c2530aa6bfe671b83fd46/fastapi-0.78.0.tar.gz (mirror.py:875)
2022-11-07 11:03:50,371 INFO: Downloading: https://files.pythonhosted.org/packages/ae/ed/ea37410618f1c206ba857d391d7b2de6de7a758ea586662aef77c945d3b4/fastapi-0.79.0.tar.gz (mirror.py:875)
2022-11-07 11:03:52,244 INFO: Downloading: https://files.pythonhosted.org/packages/48/eb/feec98de25762193702e909535fbf4a1b3cb63617e6ee2e72c95ae4789ba/fastapi-0.79.1.tar.gz (mirror.py:875)
2022-11-07 11:03:54,925 INFO: Downloading: https://files.pythonhosted.org/packages/4d/58/e91d3dc0b12f26ea73891fd07c5b2d8a3492e732fefe506584e24de9d8e3/fastapi-0.8.0.tar.gz (mirror.py:875)
2022-11-07 11:03:55,902 INFO: Downloading: https://files.pythonhosted.org/packages/82/93/6bd83151004f2188e016589e4e4f48890087cdf84b3a25212216773258f1/fastapi-0.80.0.tar.gz (mirror.py:875)
2022-11-07 11:03:58,233 INFO: Downloading: https://files.pythonhosted.org/packages/d0/64/63e77ebc5c641dd3d021acd658de8b8710060c742b3557c02f8b4df272a2/fastapi-0.81.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:03:58,314 INFO: Downloading: https://files.pythonhosted.org/packages/cb/3b/f77f6c450882b23343552d06ad09658d14d535dd6b571fa09b8444cb4628/fastapi-0.81.0.tar.gz (mirror.py:875)
2022-11-07 11:04:00,790 INFO: Downloading: https://files.pythonhosted.org/packages/56/c7/e36aa8a7a04a2536b559abd7ced3a69fbabb324b27911b7a4c50276167cf/fastapi-0.82.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:04:00,859 INFO: Downloading: https://files.pythonhosted.org/packages/10/95/33ddb2614d59317a18501ef3f598be0e726f2ce7993feadbdf076a9413a1/fastapi-0.82.0.tar.gz (mirror.py:875)
2022-11-07 11:04:03,266 INFO: Downloading: https://files.pythonhosted.org/packages/bc/34/6746797c8b5275649f99ed57e5a6dd60f912649c0f8ac985b362efd9e8c7/fastapi-0.83.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:04:03,332 INFO: Downloading: https://files.pythonhosted.org/packages/61/4e/4913c1672374a8161af5e0f865f1a33d8faa185aecaf61b8c288dca1d4fa/fastapi-0.83.0.tar.gz (mirror.py:875)
2022-11-07 11:04:05,991 INFO: Downloading: https://files.pythonhosted.org/packages/6b/1c/e80add75c4c8383d6041a10ca5ee9cdb185ac9d7a8f9ffa94975010e72ca/fastapi-0.84.0.tar.gz (mirror.py:875)
2022-11-07 11:04:08,415 INFO: Downloading: https://files.pythonhosted.org/packages/f8/f6/5334a17a8acb95b2b71825db6c8c3d2b984d1d0c31266fcda02480ab62ab/fastapi-0.85.0-py3-none-any.whl (mirror.py:875)
2022-11-07 11:04:08,504 INFO: Downloading: https://files.pythonhosted.org/packages/f2/74/15805b9921c0fa99a732bbab71fc548a269d027b6540f48043f87338a273/fastapi-0.85.0.tar.gz (mirror.py:875)
2022-11-07 11:04:11,223 INFO: Downloading: https://files.pythonhosted.org/packages/76/06/167f461067a95fb631fdf65657089364dc43844bc38d8c39374c3abbc746/fastapi-0.85.1.tar.gz (mirror.py:875)
2022-11-07 11:04:13,552 INFO: Downloading: https://files.pythonhosted.org/packages/99/d4/4256804791b1e822f46bf79015270e9e9f14e9b634cb8231a88f6dc100c3/fastapi-0.85.2-py3-none-any.whl (mirror.py:875)
2022-11-07 11:04:13,620 INFO: Downloading: https://files.pythonhosted.org/packages/f9/7a/8a2cd82257017a4c15f13a8e831bc22c52cc0a3e9fad5a2cc00c491e733f/fastapi-0.85.2.tar.gz (mirror.py:875)
2022-11-07 11:04:16,248 INFO: Downloading: https://files.pythonhosted.org/packages/3d/c4/0cbe3b1213cdb4b3dd8692ed30788b01bf49d88d71afcb1c296a608f6029/fastapi-0.86.0.tar.gz (mirror.py:875)
2022-11-07 11:04:18,920 INFO: Downloading: https://files.pythonhosted.org/packages/d7/2b/08583e9aeaacde54a1bc814a29916e390ebd36f7d54d53e9ef5b3236d21c/fastapi-0.9.0.tar.gz (mirror.py:875)
2022-11-07 11:04:19,956 INFO: Downloading: https://files.pythonhosted.org/packages/98/c7/5c98837ca82d4e49c16891100724328931bd07b79e61528291bbf94436bb/fastapi-0.9.1.tar.gz (mirror.py:875)
2022-11-07 11:04:20,958 ERROR: Error syncing package: fastapi@15646760 (mirror.py:377)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 130, in package_syncer
    await self.process_package(package)
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 337, in process_package
    await self.sync_release_files(package)
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 693, in sync_release_files
    raise deferred_exception  # raise the exception after trying all files
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/71/48/64f0a29bd601a90e323562547a6989db221ad5f69c77e0b7565f8ec477d0'
2022-11-07 11:04:20,959 INFO: Generating global index page. (simple.py:223)
2022-11-07 11:04:21,118 INFO: 2 packages had changes (mirror.py:990)
2022-11-07 11:04:21,118 INFO: Writing diff file to mirrored-files (mirror.py:1000)

Environment configuration

bandersnatch version: 6.0.1

docker-compose file:

services:
  bandersnatch:
    image: pypa/bandersnatch:latest
    platform: linux/amd64
    volumes:
      - "./config:/conf"
      - "./data:/srv/pypi/web"
  bandersnatch_nginx:
    image: bandersnatch_nginx
    build: .
    platform: linux/amd64
    volumes:
      - "./data:/data/pypi/web:ro"
    ports:
      - "40080:80"

Config file:

[mirror]
directory = /srv/pypi
json = false
release-files = true
cleanup = false
master = https://pypi.org
timeout = 10
global-timeout = 1800
workers = 3
hash-index = false
simple-format = ALL
stop-on-error = false
storage-backend = filesystem
verifiers = 3
compare-method = hash

[plugins]
enabled =
    allowlist_project
    allowlist_release

[allowlist]
packages =
    typer[all]
    fastapi[all]
    docker[all]
cooperlees commented 2 years ago

Hi there,

These sound worth looking into. I've never seen the [all] after a package name - Is that part of the allowlist_release? I would just use the allowlist_project and put:

typer
fastapi
docker

You're also forgetting the dependencies of these projects. I would create a new venv and pip install each of these and use pip freeze to see all the packages you need ....

Errors

1) I would rm the file(s) that already exist and see if it succeeds 2) FileNotFoundError is weird. We should see if the mkdirs fail or if we have a bug

What file system you using to store all the blobs?

tibeer commented 2 years ago

Nice! Done this. I know that the dependencies are not there yet. Later we will have a fully generated SBOM which will then create the allowlist automatically. Currently I use these three packages just for testing.

After changing the configuration to look like this:

(...)

[plugins]
enabled =
    allowlist_project

[allowlist]
packages =
    typer
    fastapi
    docker

The output looks like this:

user@machine pip % docker exec -it pip-bandersnatch-1 bandersnatch -c /conf/bandersnatch.conf mirror
2022-11-09 08:21:13,750 INFO: Selected storage backend: filesystem (configuration.py:131)
2022-11-09 08:21:13,753 INFO: Selected compare method: hash (configuration.py:177)
2022-11-09 08:21:14,489 INFO: Initialized project plugin allowlist_project, filtering ['fastapi', 'docker', 'typer'] (allowlist_name.py:31)
2022-11-09 08:21:14,681 INFO: Status file /srv/pypi/status missing. Starting over. (mirror.py:566)
2022-11-09 08:21:14,682 INFO: Syncing with https://pypi.org. (mirror.py:57)
2022-11-09 08:21:14,682 INFO: Current mirror serial: 0 (mirror.py:278)
2022-11-09 08:21:14,682 INFO: Syncing all packages. (mirror.py:293)
2022-11-09 08:21:48,124 INFO: Package 'typer' is allowlisted (allowlist_name.py:88)
2022-11-09 08:21:48,458 INFO: Package 'fastapi' is allowlisted (allowlist_name.py:88)
2022-11-09 08:21:48,463 INFO: Package 'docker' is allowlisted (allowlist_name.py:88)
2022-11-09 08:21:55,382 INFO: Trying to reach serial: 15708855 (mirror.py:310)
2022-11-09 08:21:55,383 INFO: 3 packages to sync. (mirror.py:312)
2022-11-09 08:21:55,428 INFO: No metadata filters are enabled. Skipping metadata filtering (mirror.py:76)
2022-11-09 08:21:55,428 INFO: No release filters are enabled. Skipping release filtering (mirror.py:78)
2022-11-09 08:21:55,428 INFO: No release file filters are enabled. Skipping release file filtering (mirror.py:80)
2022-11-09 08:21:55,431 INFO: Fetching metadata for package: docker (serial 15631690) (package.py:58)
2022-11-09 08:21:55,435 INFO: Fetching metadata for package: fastapi (serial 15646760) (package.py:58)
2022-11-09 08:21:55,437 INFO: Fetching metadata for package: typer (serial 15668790) (package.py:58)
2022-11-09 08:21:57,376 INFO: Storing index page(s): typer - in /srv/pypi/web/simple/typer (mirror.py:698)
2022-11-09 08:22:00,120 INFO: Storing index page(s): docker - in /srv/pypi/web/simple/docker (mirror.py:698)
2022-11-09 08:22:02,893 INFO: Downloading: https://files.pythonhosted.org/packages/6a/80/b9154bd11b982b0c71cd04941397ed37d1c5e83157301e287549843d1895/fastapi-0.13.0.tar.gz (mirror.py:875)
2022-11-09 08:22:03,680 INFO: Downloading: https://files.pythonhosted.org/packages/45/51/163ed7660f0072e96fd7adfde2c61a259c21c943fbf8f1626c6175f6bcdf/fastapi-0.14.0.tar.gz (mirror.py:875)
2022-11-09 08:22:04,485 INFO: Downloading: https://files.pythonhosted.org/packages/2f/ab/77b87506bfbbfbc22de476e29628bb1c74b379b4995e0a340ac7a188336c/fastapi-0.15.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:04,559 INFO: Downloading: https://files.pythonhosted.org/packages/d3/50/76a87489308794745372f93aa86ab14fff746b1f2799988fe33f3ddf3bea/fastapi-0.15.0.tar.gz (mirror.py:875)
2022-11-09 08:22:06,186 INFO: Downloading: https://files.pythonhosted.org/packages/68/2f/40df6a44685e8f41104724124a9a8ffefa52feeb3088bc1c401ab3c6eb0b/fastapi-0.17.0.tar.gz (mirror.py:875)
2022-11-09 08:22:06,912 INFO: Downloading: https://files.pythonhosted.org/packages/d9/ee/0b818cfe2449e7f7b971699c2af12cc6a99d8bae77c580d2e6ca355ef53c/fastapi-0.18.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:07,047 INFO: Downloading: https://files.pythonhosted.org/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3/fastapi-0.18.0.tar.gz (mirror.py:875)
2022-11-09 08:22:07,059 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3/fastapi-0.18.0.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3'
2022-11-09 08:22:07,067 INFO: Downloading: https://files.pythonhosted.org/packages/ed/75/bdaf4dc564b907dc65897b750b30d2246cbe5c237b6c04884dcab473eaa6/fastapi-0.19.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:07,125 INFO: Downloading: https://files.pythonhosted.org/packages/a7/2d/97d6367bec2367b586349e9a35cfa8e269a41a110e5c7910759709854b4a/fastapi-0.19.0.tar.gz (mirror.py:875)
2022-11-09 08:22:08,599 INFO: Downloading: https://files.pythonhosted.org/packages/6c/4b/d0e6665171d4aa950643c3d8251253b0c0ce0aaaf890a109d280153b18d7/fastapi-0.2.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:08,675 INFO: Downloading: https://files.pythonhosted.org/packages/fc/1f/eab23d52f245e3b09aee2ae85e2507a0f4a56f7ec562698fad9e88b895cb/fastapi-0.2.0.tar.gz (mirror.py:875)
2022-11-09 08:22:09,412 INFO: Downloading: https://files.pythonhosted.org/packages/8b/1f/ad6520c13430439f1978eccaab6d943ad7669c162c149a3e11573c816bc4/fastapi-0.2.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:09,474 INFO: Downloading: https://files.pythonhosted.org/packages/e6/a3/bffda6970d7153cb519968e3b41275365f190327345073bbbc7ff20d9140/fastapi-0.2.1.tar.gz (mirror.py:875)
2022-11-09 08:22:10,075 INFO: Downloading: https://files.pythonhosted.org/packages/9b/01/8e37b198a05b1cb2da5247bc5d57d8907da776b3d8b8c72661aab32af2ec/fastapi-0.20.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:10,298 INFO: Downloading: https://files.pythonhosted.org/packages/c8/37/9931d412ba3132f2c4332682e0b8bb8ddc0f60471e0a8d6896fa45c73f1c/fastapi-0.20.0.tar.gz (mirror.py:875)
2022-11-09 08:22:11,114 INFO: Downloading: https://files.pythonhosted.org/packages/19/65/c9b56507a3c4ecefaeb5e14bfcb6d660f460141105c2f7c893913da60626/fastapi-0.20.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:11,181 INFO: Downloading: https://files.pythonhosted.org/packages/ba/9a/c1a0504028822ec649a45b52dce11d25b60d7a4b93510a39c9e41435fdc2/fastapi-0.20.1.tar.gz (mirror.py:875)
2022-11-09 08:22:11,193 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/ba/9a/c1a0504028822ec649a45b52dce11d25b60d7a4b93510a39c9e41435fdc2/fastapi-0.20.1.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/ba/9a/c1a0504028822ec649a45b52dce11d25b60d7a4b93510a39c9e41435fdc2'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/ba/9a/c1a0504028822ec649a45b52dce11d25b60d7a4b93510a39c9e41435fdc2'
2022-11-09 08:22:11,197 INFO: Downloading: https://files.pythonhosted.org/packages/4a/f0/e0c37e7e0220eadfb0645431d3773e0b59a3ee765d8c4840c21294d8b1e2/fastapi-0.21.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:11,443 INFO: Downloading: https://files.pythonhosted.org/packages/52/46/76fc59fd9b472efbc6b00a537b061c22db8ee2b249e87a1ee5c8e9eff306/fastapi-0.21.0.tar.gz (mirror.py:875)
2022-11-09 08:22:12,299 INFO: Downloading: https://files.pythonhosted.org/packages/f2/10/b769b1f7059486a9f58d55d3f7ae16d071159f879c28012d4c189e8b86dc/fastapi-0.22.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:12,370 INFO: Downloading: https://files.pythonhosted.org/packages/2c/1d/bcf27e8f99a716cc60dfc9c1258d90d82f05b6c650d2c768eb2ae71d9b63/fastapi-0.22.0.tar.gz (mirror.py:875)
2022-11-09 08:22:13,332 INFO: Downloading: https://files.pythonhosted.org/packages/e3/bd/cabaa48901ccf8abcac1067613b96d57ba4aaf718cfa36f0c5b715c10cea/fastapi-0.23.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:13,400 INFO: Downloading: https://files.pythonhosted.org/packages/5e/58/3eeecfc9acb2a5d79b4b523d6cc6f97f122a5ead5ad366f01e750036a74e/fastapi-0.23.0.tar.gz (mirror.py:875)
2022-11-09 08:22:14,216 INFO: Downloading: https://files.pythonhosted.org/packages/71/48/64f0a29bd601a90e323562547a6989db221ad5f69c77e0b7565f8ec477d0/fastapi-0.24.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:14,300 INFO: Downloading: https://files.pythonhosted.org/packages/9c/85/d38aa42a29231906bb559cca8bb2f032f170bfbf647fe446bc90258294ba/fastapi-0.24.0.tar.gz (mirror.py:875)
2022-11-09 08:22:15,353 INFO: Downloading: https://files.pythonhosted.org/packages/b7/48/6a691a87c3eb8638e2e6adb8e1a0e34d35067122a63db29e8c2b435ff3e0/fastapi-0.25.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:15,426 INFO: Downloading: https://files.pythonhosted.org/packages/50/16/a7b8f7cdb679e8f81547e0f9d6d9049815a5cbf187738a60be6e682e0089/fastapi-0.25.0.tar.gz (mirror.py:875)
2022-11-09 08:22:16,272 INFO: Downloading: https://files.pythonhosted.org/packages/ad/df/6d757dab8ea480be15f5b600ee90aaf149c16a3780b8cd50bc749f65fdf1/fastapi-0.26.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:16,340 INFO: Downloading: https://files.pythonhosted.org/packages/db/a2/8683239773f12c1f97ffd2d76223882a5ecd86abfabc45ceb078d1b668f2/fastapi-0.26.0.tar.gz (mirror.py:875)
2022-11-09 08:22:17,159 INFO: Downloading: https://files.pythonhosted.org/packages/c3/fb/2af84a2e65f5453561c4cc4f571aa282dc8780df2a212fd17951aadddca4/fastapi-0.27.0.tar.gz (mirror.py:875)
2022-11-09 08:22:17,969 INFO: Downloading: https://files.pythonhosted.org/packages/eb/36/31d0a08c3303a4f56494f489d615f49c13603579c6ed49b301f21b711a9b/fastapi-0.27.1.tar.gz (mirror.py:875)
2022-11-09 08:22:18,755 INFO: Downloading: https://files.pythonhosted.org/packages/48/6a/78cecd90b1fc4e62408a53ae4e6de1daa21762c0e1f251fb8a26e2ad061b/fastapi-0.27.2.tar.gz (mirror.py:875)
2022-11-09 08:22:19,526 INFO: Downloading: https://files.pythonhosted.org/packages/07/66/99f068180f47967a89118b0d277e77cbb18f734ec5988200d49e10c12ff5/fastapi-0.28.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:19,963 INFO: Downloading: https://files.pythonhosted.org/packages/e6/b1/cec35fe22b1f15afabf5d02f7b3c3885dacf6cc5364f14ffa58da7febfbc/fastapi-0.28.0.tar.gz (mirror.py:875)
2022-11-09 08:22:20,759 INFO: Downloading: https://files.pythonhosted.org/packages/3e/c0/2a3bb0fbc08dd3067cb119458b147ba200900c3b932562887cc73d54ecad/fastapi-0.29.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:20,832 INFO: Downloading: https://files.pythonhosted.org/packages/fb/2a/32279b88584b345333581974843820d0bb8a8ecf956b065a013138362a59/fastapi-0.29.0.tar.gz (mirror.py:875)
2022-11-09 08:22:21,648 INFO: Downloading: https://files.pythonhosted.org/packages/c6/75/6949c65017ec6bc402f734ac94eefebc2d1aeb8142682904ae96dd4b271e/fastapi-0.29.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:21,742 INFO: Downloading: https://files.pythonhosted.org/packages/6c/6a/6bca3022a045066fa2e64eca6b64a6ddc1fe6e2b753fc39128b46df6678b/fastapi-0.29.1.tar.gz (mirror.py:875)
2022-11-09 08:22:22,574 INFO: Downloading: https://files.pythonhosted.org/packages/bb/56/c1f277ba279e3459e39107429a10833ed2745b26077f6ff8bb84c3b069d7/fastapi-0.3.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:22,625 INFO: Downloading: https://files.pythonhosted.org/packages/3e/5a/bd109788bf5c76661511bc51ac1c3b67f5040f9579ebc10bd31559f5e5f9/fastapi-0.3.0.tar.gz (mirror.py:875)
2022-11-09 08:22:24,026 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/3e/5a/bd109788bf5c76661511bc51ac1c3b67f5040f9579ebc10bd31559f5e5f9/fastapi-0.3.0.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 911, in download_file
    self.storage_backend.set_upload_time(path, upload_time)
  File "/usr/local/lib/python3.10/site-packages/bandersnatch_storage_plugins/filesystem.py", line 288, in set_upload_time
    os.utime(path, (ts, ts))
PermissionError: [Errno 1] Operation not permitted
2022-11-09 08:22:24,031 INFO: Downloading: https://files.pythonhosted.org/packages/45/e0/0c777f9c2705140490617b172c9bc5c0b79f2816bb882719bb472498741e/fastapi-0.30.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:24,105 INFO: Downloading: https://files.pythonhosted.org/packages/3c/16/f389a874e9a1235227c1c20e709c5503a0621195796286492599d7bd87df/fastapi-0.30.0.tar.gz (mirror.py:875)
2022-11-09 08:22:25,022 INFO: Downloading: https://files.pythonhosted.org/packages/cf/e9/28572f64e1380cab686316cfd2371a512bbf22f8ed28b03da73899efc447/fastapi-0.30.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:25,109 INFO: Downloading: https://files.pythonhosted.org/packages/f9/f3/6ecd806db796606431a78de4eff9edcf42f788ff653e9acf4c7f6057c38f/fastapi-0.30.1.tar.gz (mirror.py:875)
2022-11-09 08:22:26,771 INFO: Downloading: https://files.pythonhosted.org/packages/85/69/739de0af8f8db61d9cc1367048eca6c5d161e8869eeed6c9bfcb7434ef6c/fastapi-0.31.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:26,833 INFO: Downloading: https://files.pythonhosted.org/packages/3d/4e/7ea13b3e4c0590b57d8138041cfb511dd2b450f97316f138951348851dc0/fastapi-0.31.0.tar.gz (mirror.py:875)
2022-11-09 08:22:26,844 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/3d/4e/7ea13b3e4c0590b57d8138041cfb511dd2b450f97316f138951348851dc0/fastapi-0.31.0.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/3d/4e/7ea13b3e4c0590b57d8138041cfb511dd2b450f97316f138951348851dc0'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/3d/4e/7ea13b3e4c0590b57d8138041cfb511dd2b450f97316f138951348851dc0'
2022-11-09 08:22:26,848 INFO: Downloading: https://files.pythonhosted.org/packages/2c/da/9f1ee461ce48e34b2accd0cbb45d3c527049508e965ace846a48c83957d2/fastapi-0.32.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:27,130 INFO: Downloading: https://files.pythonhosted.org/packages/d1/ce/2e59c0404fce6237d2fc99df0858459ea605238d16e45720a64824f8851c/fastapi-0.32.0.tar.gz (mirror.py:875)
2022-11-09 08:22:27,931 INFO: Downloading: https://files.pythonhosted.org/packages/52/78/0289b14c64d819ad49ef28c8453a3906ef6a19b0f1d977f0334066c01681/fastapi-0.33.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:28,414 INFO: Downloading: https://files.pythonhosted.org/packages/94/01/9fdade622c17ebe2f24dd32df87ae8cd69dc5d6046eb2fec5f5a9c6fdefe/fastapi-0.33.0.tar.gz (mirror.py:875)
2022-11-09 08:22:29,244 INFO: Downloading: https://files.pythonhosted.org/packages/45/9e/483c79a63ca3062cc844442b1e88293dcf524ca724742538f036e617dca1/fastapi-0.34.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:29,324 INFO: Downloading: https://files.pythonhosted.org/packages/d8/bd/b4083b9f38a3f62dbb3dca2d7094d5941efdbff39ca1b57da3364da0dfb1/fastapi-0.34.0.tar.gz (mirror.py:875)
2022-11-09 08:22:30,313 INFO: Downloading: https://files.pythonhosted.org/packages/07/b7/ebc45989b2c7bfca3b49a579ad38d0011ba3054ce4a6666278933145a1dd/fastapi-0.35.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:30,392 INFO: Downloading: https://files.pythonhosted.org/packages/67/35/259ef7a337036fbe21be0748515481f0f7dd328100db27c7e3e2acebbe8d/fastapi-0.35.0.tar.gz (mirror.py:875)
2022-11-09 08:22:31,095 INFO: Downloading: https://files.pythonhosted.org/packages/bb/94/7b5953d610858b0d0324b849e13cdf97bef476a27d8d8ca3494c35a6eb54/fastapi-0.36.0.tar.gz (mirror.py:875)
2022-11-09 08:22:32,000 INFO: Downloading: https://files.pythonhosted.org/packages/7b/1e/e033a6c57355eb16e29fe7220911f3a4a87fe163b5674a29eb758e33e428/fastapi-0.37.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:32,217 INFO: Downloading: https://files.pythonhosted.org/packages/34/12/093fe39888016473561d302327a013301a4ca8b9509c7a6b9af26aecfdd0/fastapi-0.37.0.tar.gz (mirror.py:875)
2022-11-09 08:22:32,237 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/34/12/093fe39888016473561d302327a013301a4ca8b9509c7a6b9af26aecfdd0/fastapi-0.37.0.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/34/12/093fe39888016473561d302327a013301a4ca8b9509c7a6b9af26aecfdd0'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/34/12/093fe39888016473561d302327a013301a4ca8b9509c7a6b9af26aecfdd0'
2022-11-09 08:22:32,242 INFO: Downloading: https://files.pythonhosted.org/packages/a0/f0/e5a727d256ddaaddb37493cd182fcf2d2feffe04ffbc06194cd57e6bbcdf/fastapi-0.38.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:32,355 INFO: Downloading: https://files.pythonhosted.org/packages/1b/f5/595bb169d0d85f7d3811fcf268c0872a05cb48cdd1ac1e0a14b063de3972/fastapi-0.38.0.tar.gz (mirror.py:875)
2022-11-09 08:22:33,151 INFO: Downloading: https://files.pythonhosted.org/packages/37/59/1a42dde38f1ae2a7a318947e54fabd1fc02ac423ecc91957c417065e7cc6/fastapi-0.38.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:33,265 INFO: Downloading: https://files.pythonhosted.org/packages/af/63/76229a4268091757dfce3f63487e8c9b92639c30a8396757679e3a20c6b6/fastapi-0.38.1.tar.gz (mirror.py:875)
2022-11-09 08:22:34,281 INFO: Downloading: https://files.pythonhosted.org/packages/81/c8/28222022dada4209428ae6e4d6e2ec170872696c10eaec66d4dc792572b3/fastapi-0.39.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:34,379 INFO: Downloading: https://files.pythonhosted.org/packages/8b/20/eb050de401ef0a302f20452e123af841af47306b034f9044c279ae5b37d3/fastapi-0.39.0.tar.gz (mirror.py:875)
2022-11-09 08:22:35,260 INFO: Downloading: https://files.pythonhosted.org/packages/5f/a6/8700fefc54d819b97c259b99e510298041cd6de7571f58f6054ed0474100/fastapi-0.4.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:35,333 INFO: Downloading: https://files.pythonhosted.org/packages/8c/65/12ba1e298bca05dc2109f96c35c4a54c5aeadeb81e9fd88ebbead9cb7bdd/fastapi-0.4.0.tar.gz (mirror.py:875)
2022-11-09 08:22:35,982 INFO: Downloading: https://files.pythonhosted.org/packages/b4/6f/2ba55d2571e9dd97896695bcefc7f30c26e1d5c09d12caec925680235c39/fastapi-0.40.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:36,073 INFO: Downloading: https://files.pythonhosted.org/packages/c4/cd/685523fc953335ac62dd4ceb9347994a85b768d2b32d1d829ce82e8048dd/fastapi-0.40.0.tar.gz (mirror.py:875)
2022-11-09 08:22:36,894 INFO: Downloading: https://files.pythonhosted.org/packages/fc/08/968e7acf9619a93aa7e9570f4bf31aee0aef46d1b6caeb7ae8c53c626f37/fastapi-0.41.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:37,188 INFO: Downloading: https://files.pythonhosted.org/packages/6e/31/5f3b44f0f572c523e78a05bf2bca155466b95e4746ad5a4d500736b86f9c/fastapi-0.41.0.tar.gz (mirror.py:875)
2022-11-09 08:22:38,874 INFO: Downloading: https://files.pythonhosted.org/packages/4a/28/97c3b661e7bebe8508a58343c4242603d75773c18199d719c2cfd8b8428b/fastapi-0.42.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:38,954 INFO: Downloading: https://files.pythonhosted.org/packages/90/31/099a3abb5d43db1a0fc29144e4dd8681ca33a6005473fd315ff364c6e5c6/fastapi-0.42.0.tar.gz (mirror.py:875)
2022-11-09 08:22:39,835 INFO: Downloading: https://files.pythonhosted.org/packages/76/93/7986f027577782162a448b66353cd7050d27138b77262b1de1f723cc59ce/fastapi-0.43.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:39,853 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/76/93/7986f027577782162a448b66353cd7050d27138b77262b1de1f723cc59ce/fastapi-0.43.0-py3-none-any.whl (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/76/93/7986f027577782162a448b66353cd7050d27138b77262b1de1f723cc59ce'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/76/93/7986f027577782162a448b66353cd7050d27138b77262b1de1f723cc59ce'
2022-11-09 08:22:39,858 INFO: Downloading: https://files.pythonhosted.org/packages/b9/73/c59aca57ed410d531ca31cda428c6e03c1c07bdc466cd3b5d3dbebc5fdfc/fastapi-0.43.0.tar.gz (mirror.py:875)
2022-11-09 08:22:40,661 INFO: Downloading: https://files.pythonhosted.org/packages/c7/87/0c64669ac0769616487cc53dc8e5b49f0c5842b760b727785196a61e3b73/fastapi-0.44.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:40,720 INFO: Downloading: https://files.pythonhosted.org/packages/ea/24/d65623a36f970764797edb4b4bbe8d9166f4911a28371410d01bd6ef0cd6/fastapi-0.44.0.tar.gz (mirror.py:875)
2022-11-09 08:22:41,541 INFO: Downloading: https://files.pythonhosted.org/packages/48/0d/4b6150256b086ea643079ddfad81e9999dde910236b60ea464d9bde10a44/fastapi-0.44.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:41,596 INFO: Downloading: https://files.pythonhosted.org/packages/66/9e/cf4837c3cc4d96caddf97a2974c8bb02204ffae7fc9c0ceaff9c21cf3c49/fastapi-0.44.1.tar.gz (mirror.py:875)
2022-11-09 08:22:42,422 INFO: Downloading: https://files.pythonhosted.org/packages/6b/f4/8aa81e9e5de3877a3149f7e53b21cc3de28d2a474692f17b79b6baf1deb8/fastapi-0.45.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:42,483 INFO: Downloading: https://files.pythonhosted.org/packages/ce/eb/93adebcaf0ddddc4d185520d6bad5c00d2b3b5f70abe15ac16555e3a5b50/fastapi-0.45.0.tar.gz (mirror.py:875)
2022-11-09 08:22:43,327 INFO: Downloading: https://files.pythonhosted.org/packages/7b/c4/3593af517fbdeb51443d8376f2cbe3c63cb46531aa66415516251119a398/fastapi-0.46.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:43,574 INFO: Downloading: https://files.pythonhosted.org/packages/b4/cc/44941903f220aad11f7252d729dc32a7cb2ec20d4ffd78053abea4a4d050/fastapi-0.46.0.tar.gz (mirror.py:875)
2022-11-09 08:22:43,586 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/b4/cc/44941903f220aad11f7252d729dc32a7cb2ec20d4ffd78053abea4a4d050/fastapi-0.46.0.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/b4/cc/44941903f220aad11f7252d729dc32a7cb2ec20d4ffd78053abea4a4d050'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/b4/cc/44941903f220aad11f7252d729dc32a7cb2ec20d4ffd78053abea4a4d050'
2022-11-09 08:22:43,590 INFO: Downloading: https://files.pythonhosted.org/packages/c7/67/d489088f26e9d4846043cc15160dcabba117474ee6b76c7db7fb215f7c71/fastapi-0.47.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:43,800 INFO: Downloading: https://files.pythonhosted.org/packages/de/b1/cca52dc8e2bbf91d4e411bc87f3160cc5f6856e75a9e0b081fef25bc77ac/fastapi-0.47.0.tar.gz (mirror.py:875)
2022-11-09 08:22:45,700 INFO: Downloading: https://files.pythonhosted.org/packages/a3/a7/4804d7abf8a1544d079d50650af872387154ebdac5bd07d54b2e60e2b334/fastapi-0.47.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:45,758 INFO: Downloading: https://files.pythonhosted.org/packages/24/98/4fc080a7caafd79deb3abdd899be45337e78e6768aba08678aee7c4edfc3/fastapi-0.47.1.tar.gz (mirror.py:875)
2022-11-09 08:22:46,592 INFO: Downloading: https://files.pythonhosted.org/packages/37/d9/679462f5d48458afc8afcc3c8cc62177843aaafb416162666c3fa7b162f3/fastapi-0.48.0.tar.gz (mirror.py:875)
2022-11-09 08:22:47,412 INFO: Downloading: https://files.pythonhosted.org/packages/10/7e/691edfb8fc0bc7f201be0dcd92f58836a57abffe3dee10d24adb301c6da7/fastapi-0.49.0.tar.gz (mirror.py:875)
2022-11-09 08:22:48,238 INFO: Downloading: https://files.pythonhosted.org/packages/db/fd/3d6b6a70892784f7bfba11a3755d7271613d0f0db438dfb4b001f39f21d0/fastapi-0.49.1.tar.gz (mirror.py:875)
2022-11-09 08:22:49,159 INFO: Downloading: https://files.pythonhosted.org/packages/b8/2a/13ca48d28a51ebad2f0e12f9084252ac02d60e7c207737c5fae5d1639d0e/fastapi-0.49.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:49,394 INFO: Downloading: https://files.pythonhosted.org/packages/c7/97/b0fc25252a3d74c27e392505660ed1d9e36f116a2783dfccd692c759c3b3/fastapi-0.49.2.tar.gz (mirror.py:875)
2022-11-09 08:22:50,818 INFO: Downloading: https://files.pythonhosted.org/packages/c3/31/127290b5be5e72423e8937506830964b50e818a2039db3ec1d46b0abade7/fastapi-0.5.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:51,091 INFO: Downloading: https://files.pythonhosted.org/packages/e4/27/eb1e323b2eb60dab88d93ec6dae4f76970b1e441a70d8573e030ae0da02c/fastapi-0.5.0.tar.gz (mirror.py:875)
2022-11-09 08:22:51,734 INFO: Downloading: https://files.pythonhosted.org/packages/3e/08/1ac8eda55669cd5c2b2fd343ee81e460cf6a24f49368fd7de28c0c0a6023/fastapi-0.5.1.tar.gz (mirror.py:875)
2022-11-09 08:22:52,317 INFO: Downloading: https://files.pythonhosted.org/packages/82/fd/f967d9845c85d475e1a3fe228ae72b04e0dcb615638b8b2e10f794f825ff/fastapi-0.50.0.tar.gz (mirror.py:875)
2022-11-09 08:22:53,222 INFO: Downloading: https://files.pythonhosted.org/packages/e7/dc/930093c07ef0ce8fa960139bbbc6cf0b2b4343c5b0faf4222e2e7afa826a/fastapi-0.51.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:53,260 INFO: Downloading: https://files.pythonhosted.org/packages/d8/a4/a192938c358ba12043fb5f34ef9319d4ba776c53bfc4bd893c0d21fdbd9e/fastapi-0.51.0.tar.gz (mirror.py:875)
2022-11-09 08:22:54,275 INFO: Downloading: https://files.pythonhosted.org/packages/18/5b/46c084c174fc69b2a7e1d9c22d014f39fb677d9a7635f24734ef56e0fb53/fastapi-0.52.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:54,340 INFO: Downloading: https://files.pythonhosted.org/packages/7f/3a/d19b7af86f61877c2d976b3b220ae8b2b22c45fa8f0d0787e9f32d40fcc2/fastapi-0.52.0.tar.gz (mirror.py:875)
2022-11-09 08:22:54,350 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/7f/3a/d19b7af86f61877c2d976b3b220ae8b2b22c45fa8f0d0787e9f32d40fcc2/fastapi-0.52.0.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/7f/3a/d19b7af86f61877c2d976b3b220ae8b2b22c45fa8f0d0787e9f32d40fcc2'
2022-11-09 08:22:54,353 INFO: Downloading: https://files.pythonhosted.org/packages/f9/eb/f899ccd1f052bb306d3938696458a403ee61a116fd784bc9fb266f6ce211/fastapi-0.53.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:54,395 INFO: Downloading: https://files.pythonhosted.org/packages/ee/fa/a9bdf3410669cb2f10e9fe4e11d1ae13338ed7947745e8b3797a6bff5c8a/fastapi-0.53.0.tar.gz (mirror.py:875)
2022-11-09 08:22:55,535 INFO: Downloading: https://files.pythonhosted.org/packages/cb/19/5bb41e0f33413cf768a63451945a2166ca76c14d4a42f79c7b628d7bfaae/fastapi-0.53.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:55,619 INFO: Downloading: https://files.pythonhosted.org/packages/fd/1c/752cee1610bea575e60fa975ff3d5b535ede94a7742da6f43b9b5c3f6da8/fastapi-0.53.1.tar.gz (mirror.py:875)
2022-11-09 08:22:56,594 INFO: Downloading: https://files.pythonhosted.org/packages/f7/6b/d7c462d6dbf9460981389b02045bdf730f55e079c3497f197db44fef14e4/fastapi-0.53.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:56,679 INFO: Downloading: https://files.pythonhosted.org/packages/e3/aa/d807237eca90e3a1f49139407eda6d7a380a77a6747b1c37265bf7ecf43f/fastapi-0.53.2.tar.gz (mirror.py:875)
2022-11-09 08:22:57,702 INFO: Downloading: https://files.pythonhosted.org/packages/f6/26/fe0ef3f1ba5b0b2264da858a4407ed1fcd94f49655281487e6bd2709a8b7/fastapi-0.54.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:57,781 INFO: Downloading: https://files.pythonhosted.org/packages/f7/b9/6aad3271f8171bc098bf8a184c03d8c376ca6fb6b01a63484d37c17f9f60/fastapi-0.54.0.tar.gz (mirror.py:875)
2022-11-09 08:22:59,515 INFO: Downloading: https://files.pythonhosted.org/packages/f9/45/9c54e719b0625ea13ed921853269ece018dfea9b7a07ddef935bbf716dc9/fastapi-0.54.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:22:59,570 INFO: Downloading: https://files.pythonhosted.org/packages/4d/54/45770888a4a73666390120b444131568637e70b5e002860bad99fa1dcb27/fastapi-0.54.1.tar.gz (mirror.py:875)
2022-11-09 08:23:00,495 INFO: Downloading: https://files.pythonhosted.org/packages/80/fb/c1109c43c32bac260906e640cfc88e23fba751ba61319af779dd390aaa9b/fastapi-0.54.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:00,702 INFO: Downloading: https://files.pythonhosted.org/packages/be/a9/28297b80b3573662af8ae205c162362aa6a5308dc4ba9e381471590d9b96/fastapi-0.54.2.tar.gz (mirror.py:875)
2022-11-09 08:23:00,712 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/be/a9/28297b80b3573662af8ae205c162362aa6a5308dc4ba9e381471590d9b96/fastapi-0.54.2.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/be/a9/28297b80b3573662af8ae205c162362aa6a5308dc4ba9e381471590d9b96'
2022-11-09 08:23:00,716 INFO: Downloading: https://files.pythonhosted.org/packages/29/7f/013c7f28edd70f8825d3e95b8d19467a151cd698977a0f0a36a04110475c/fastapi-0.55.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:00,954 INFO: Downloading: https://files.pythonhosted.org/packages/bf/40/37def65cd25fc032e1b555ed8038d62a3d77613a5c47bc03311e1a9859c7/fastapi-0.55.0.tar.gz (mirror.py:875)
2022-11-09 08:23:02,034 INFO: Downloading: https://files.pythonhosted.org/packages/05/24/29cf80ab90b921fc245118762afc67e561b591a6b8b9523f650a2ddf59e5/fastapi-0.55.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:02,263 INFO: Downloading: https://files.pythonhosted.org/packages/0a/13/785d0e5967128628f1d6c05ba16d4c9bf9506d7fd35bbe5b2e269d2804ab/fastapi-0.55.1.tar.gz (mirror.py:875)
2022-11-09 08:23:03,179 INFO: Downloading: https://files.pythonhosted.org/packages/bd/0e/f313c9973973b74aef39397ce2b3e6c8d4e6e0172da43499ea80692d20b8/fastapi-0.56.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:03,237 INFO: Downloading: https://files.pythonhosted.org/packages/bc/81/1caf557ef8e721c45bb77258eb4dfda715f99bc90dbed2d59e66e5a4c545/fastapi-0.56.0.tar.gz (mirror.py:875)
2022-11-09 08:23:04,186 INFO: Downloading: https://files.pythonhosted.org/packages/9e/c5/2f96bf69038daac2925df644c8ab2ea237f19fd141039c377bf02d88d222/fastapi-0.56.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:04,236 INFO: Downloading: https://files.pythonhosted.org/packages/10/1b/6995baf88eaf291cd20e6b3a9eaab13173746bd39591e9d0faf25db5469b/fastapi-0.56.1.tar.gz (mirror.py:875)
2022-11-09 08:23:05,125 INFO: Downloading: https://files.pythonhosted.org/packages/c0/c7/b677cf5f42b09b02d8562d5d39fdec2c777966f4ba1d150885333d94aaa8/fastapi-0.57.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:05,188 INFO: Downloading: https://files.pythonhosted.org/packages/55/fe/c4f3d3f4056ed63ec0d852746529f05a9afe740c51bdc23ac037042ebc1b/fastapi-0.57.0.tar.gz (mirror.py:875)
2022-11-09 08:23:06,101 INFO: Downloading: https://files.pythonhosted.org/packages/be/e6/d2994e9e97078b05865206aacbb3afc6c7fa910794f732acccd13ee21398/fastapi-0.58.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:06,163 INFO: Downloading: https://files.pythonhosted.org/packages/0a/26/754130d8f3c85f56e98758e91bd848d50389f215cf46e5d08689adb1b9ab/fastapi-0.58.0.tar.gz (mirror.py:875)
2022-11-09 08:23:08,015 INFO: Downloading: https://files.pythonhosted.org/packages/a2/56/ddcc6a9c03592e3d447d74bf0057e35d244b3882f82a25899f6988a308ed/fastapi-0.58.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:08,099 INFO: Downloading: https://files.pythonhosted.org/packages/b0/47/a46950e883896d0280f13a4dd5b8bef2c72ebe9fd5509e360c19e2d181bf/fastapi-0.58.1.tar.gz (mirror.py:875)
2022-11-09 08:23:08,114 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/b0/47/a46950e883896d0280f13a4dd5b8bef2c72ebe9fd5509e360c19e2d181bf/fastapi-0.58.1.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/b0/47/a46950e883896d0280f13a4dd5b8bef2c72ebe9fd5509e360c19e2d181bf'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/b0/47/a46950e883896d0280f13a4dd5b8bef2c72ebe9fd5509e360c19e2d181bf'
2022-11-09 08:23:08,119 INFO: Downloading: https://files.pythonhosted.org/packages/31/24/8586a2a6ec815df9a8ac1296a4c7910314307ad3144e620af29bb77b7180/fastapi-0.59.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:08,166 INFO: Downloading: https://files.pythonhosted.org/packages/9f/c2/31ae21414301c60d0bbb83676d843aa303f2e3bc47987cb471438e8b30b6/fastapi-0.59.0.tar.gz (mirror.py:875)
2022-11-09 08:23:09,639 INFO: Downloading: https://files.pythonhosted.org/packages/fe/1a/8e2b46d2e35c08102e022f900da6d4e6567533ac1179329ac858795814b5/fastapi-0.6.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:09,859 INFO: Downloading: https://files.pythonhosted.org/packages/c9/68/f9606baa28ff12e65a55ffc76d6978f42e41a8166baa5678822d32cc60b7/fastapi-0.6.0.tar.gz (mirror.py:875)
2022-11-09 08:23:10,506 INFO: Downloading: https://files.pythonhosted.org/packages/27/1c/d76eeb84acb0c7fba81a741f205f19368aaeb7b5f512e1591ecbf92971b6/fastapi-0.6.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:10,768 INFO: Downloading: https://files.pythonhosted.org/packages/db/ff/19c04ede806ff37de2a64590daae0d2bf3fda0be2068eb475a258503b217/fastapi-0.6.1.tar.gz (mirror.py:875)
2022-11-09 08:23:11,470 INFO: Downloading: https://files.pythonhosted.org/packages/58/e6/2993c91e2732dd28a65458fd51e33c8b2d3eabd2799ee755ee028fb8b93b/fastapi-0.6.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:11,536 INFO: Downloading: https://files.pythonhosted.org/packages/2c/a4/5be495c24d80e5f0117182a836cd04c10026b38349f386d4ad7d908852e0/fastapi-0.6.2.tar.gz (mirror.py:875)
2022-11-09 08:23:12,237 INFO: Downloading: https://files.pythonhosted.org/packages/c9/eb/0bc7614bfbb98b8e00cbbd1e457e252fc9d3b3cf2f180048f649aa282c52/fastapi-0.6.3-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:12,321 INFO: Downloading: https://files.pythonhosted.org/packages/52/ef/3f770b61e25e3863fb0199014b1099728a2d6c887bb9bd59f0383e8333b9/fastapi-0.6.3.tar.gz (mirror.py:875)
2022-11-09 08:23:12,333 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/52/ef/3f770b61e25e3863fb0199014b1099728a2d6c887bb9bd59f0383e8333b9/fastapi-0.6.3.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/52/ef/3f770b61e25e3863fb0199014b1099728a2d6c887bb9bd59f0383e8333b9'
2022-11-09 08:23:12,338 INFO: Downloading: https://files.pythonhosted.org/packages/39/75/36657479a8f9f8fa7faa4029e1920925d6d2fafe1e092a99c5fddd431a69/fastapi-0.6.4-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:12,571 INFO: Downloading: https://files.pythonhosted.org/packages/5e/36/d6a12c5532a31b072f69674cb55f52c911410a60ef40687f2a9f06bfbc4f/fastapi-0.6.4.tar.gz (mirror.py:875)
2022-11-09 08:23:13,296 INFO: Downloading: https://files.pythonhosted.org/packages/0c/8b/65511a68669d731dfbb9b2f58481313aeb6b46e2088dbd4f5f79ff000d00/fastapi-0.60.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:13,517 INFO: Downloading: https://files.pythonhosted.org/packages/b0/f7/6abe5e057df3afcaa0566903ae8d60ecad64a13599e937254f23b49e7ea2/fastapi-0.60.0.tar.gz (mirror.py:875)
2022-11-09 08:23:14,489 INFO: Downloading: https://files.pythonhosted.org/packages/f7/c8/fa9ef0711be4f38dd8f381ee3e610330aaf5dfe26c880bf18565d7b1753e/fastapi-0.60.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:14,557 INFO: Downloading: https://files.pythonhosted.org/packages/83/08/3d0113f3c4c0ad650ca438d583187af434f7136843c3ed04216866db21d4/fastapi-0.60.1.tar.gz (mirror.py:875)
2022-11-09 08:23:15,882 INFO: Downloading: https://files.pythonhosted.org/packages/30/1a/0346ce8f8146d6f74d91ad15429f8bee32b7eecc500efae401fcd2578acd/fastapi-0.60.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:15,956 INFO: Downloading: https://files.pythonhosted.org/packages/ac/bc/9ec5a7400d02df102d15b53f689993ba491a11b5cfc86c90a4accb019195/fastapi-0.60.2.tar.gz (mirror.py:875)
2022-11-09 08:23:15,978 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/ac/bc/9ec5a7400d02df102d15b53f689993ba491a11b5cfc86c90a4accb019195/fastapi-0.60.2.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/ac/bc/9ec5a7400d02df102d15b53f689993ba491a11b5cfc86c90a4accb019195'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/ac/bc/9ec5a7400d02df102d15b53f689993ba491a11b5cfc86c90a4accb019195'
2022-11-09 08:23:15,982 INFO: Downloading: https://files.pythonhosted.org/packages/82/cb/96cb7cc6a807af493f0083e7d854fdd568ae5335f8f93b96c966fabd8d2f/fastapi-0.61.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:16,030 INFO: Downloading: https://files.pythonhosted.org/packages/ac/af/e10003597b5dd7a98add4b208be133161e0d886db203eca733dbe3b200b2/fastapi-0.61.0.tar.gz (mirror.py:875)
2022-11-09 08:23:16,999 INFO: Downloading: https://files.pythonhosted.org/packages/48/65/454fb440d48098845875b5ba8599efafee1efabb97720a584c78674e6d26/fastapi-0.61.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:17,062 INFO: Downloading: https://files.pythonhosted.org/packages/da/32/ea2b86e56674ff3d1bb0bbb2e3b74a04694ac0be3331e9f9d431c350bcc2/fastapi-0.61.1.tar.gz (mirror.py:875)
2022-11-09 08:23:18,952 INFO: Downloading: https://files.pythonhosted.org/packages/4c/0b/5df17eaadb7fe39dad349f484e551e802ce0581be672822f010c530d5e75/fastapi-0.61.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:19,024 INFO: Downloading: https://files.pythonhosted.org/packages/36/0c/888ebd0cdef9045b811c3e06b3860742a41d4b9699ba4e0b81fa82d9d817/fastapi-0.61.2.tar.gz (mirror.py:875)
2022-11-09 08:23:20,531 INFO: Downloading: https://files.pythonhosted.org/packages/09/9b/e45a36554f7452f6d372e607a647c3827434f5b353ef4630a7432514c928/fastapi-0.62.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:20,596 INFO: Downloading: https://files.pythonhosted.org/packages/6a/7c/b694a1e8d0620cfd9ad1f50e64f69f6b1317f55f7583931599ba7d36d2b8/fastapi-0.62.0.tar.gz (mirror.py:875)
2022-11-09 08:23:21,576 INFO: Downloading: https://files.pythonhosted.org/packages/9f/33/1b643f650688ad368983bbaf3b0658438038ea84d775dd37393d826c3833/fastapi-0.63.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:21,625 INFO: Downloading: https://files.pythonhosted.org/packages/7f/5b/23057d0cdeac3643c08937ef1348590e284842636c837108971d8af6b51d/fastapi-0.63.0.tar.gz (mirror.py:875)
2022-11-09 08:23:22,634 INFO: Downloading: https://files.pythonhosted.org/packages/0f/cc/929a628d250bc81ff39aa2a3f8d66b3ea2e07c3c93135e9b0303058ccd59/fastapi-0.64.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:22,706 INFO: Downloading: https://files.pythonhosted.org/packages/a1/fe/064bdb5598ad9dfe942b58884296bcd7b81d1e13e5af48fd328e38b2de97/fastapi-0.64.0.tar.gz (mirror.py:875)
2022-11-09 08:23:22,728 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/a1/fe/064bdb5598ad9dfe942b58884296bcd7b81d1e13e5af48fd328e38b2de97/fastapi-0.64.0.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/a1/fe/064bdb5598ad9dfe942b58884296bcd7b81d1e13e5af48fd328e38b2de97'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/a1/fe/064bdb5598ad9dfe942b58884296bcd7b81d1e13e5af48fd328e38b2de97'
2022-11-09 08:23:22,732 INFO: Downloading: https://files.pythonhosted.org/packages/2c/2a/4b5dcc2eabaa439f81387b0d3f80ebb2ea52b0436720b713fef79db32b7e/fastapi-0.65.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:22,964 INFO: Downloading: https://files.pythonhosted.org/packages/8d/31/eb754cf36c72ad0b46ca3e8de2ceadabfaee85cec74cebe226280c40f1dc/fastapi-0.65.0.tar.gz (mirror.py:875)
2022-11-09 08:23:24,286 INFO: Downloading: https://files.pythonhosted.org/packages/4e/b9/a91a699f5c201413b3f61405dbccc29ebe5ad25945230e9cec98fdb2434c/fastapi-0.65.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:24,369 INFO: Downloading: https://files.pythonhosted.org/packages/3a/e5/5eee1f9204886acb45da099f91bf34985b2c536b2746ef9bc3a937751ff7/fastapi-0.65.1.tar.gz (mirror.py:875)
2022-11-09 08:23:25,394 INFO: Downloading: https://files.pythonhosted.org/packages/dc/a8/a6be420593c4061c086e6d2ba47db46401d9af2b98b6cd33d35284f706d3/fastapi-0.65.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:25,472 INFO: Downloading: https://files.pythonhosted.org/packages/8c/5d/66e0777c6702d0f1bc238aca5ef4f8914eb564b27a04c87e158cd26bd69a/fastapi-0.65.2.tar.gz (mirror.py:875)
2022-11-09 08:23:26,624 INFO: Downloading: https://files.pythonhosted.org/packages/54/d2/1e5d77c3c16dad9582c4c86722c998b12ba7937e68e7e212dca71808626a/fastapi-0.65.3-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:26,685 INFO: Downloading: https://files.pythonhosted.org/packages/59/27/c7402c3e9ba3db1a6e7de187ad9de5d9c3b5ee6582fac43267e0c67f8937/fastapi-0.65.3.tar.gz (mirror.py:875)
2022-11-09 08:23:28,818 INFO: Downloading: https://files.pythonhosted.org/packages/f8/cb/2682d18ac7a553a0203f48190f474ab6dde6cd8815ac6822a46d611e6661/fastapi-0.66.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:28,881 INFO: Downloading: https://files.pythonhosted.org/packages/63/30/c5c72431045f502d523bdf749ce9afa90ee1591426fcdd3db05f216ca8b7/fastapi-0.66.0.tar.gz (mirror.py:875)
2022-11-09 08:23:29,922 INFO: Downloading: https://files.pythonhosted.org/packages/1b/a0/51ad4a441b28f3c3bfa0b864df4c09c9ba54e67e066f39028130fe3beff7/fastapi-0.66.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:29,982 INFO: Downloading: https://files.pythonhosted.org/packages/f3/84/ca8505d899255f00eb5c8b21817b3a77a946b22c0c469f20b54c03fb47e2/fastapi-0.66.1.tar.gz (mirror.py:875)
2022-11-09 08:23:31,082 INFO: Downloading: https://files.pythonhosted.org/packages/52/be/2a26007dc86c51e87d70021f6c1b3442726c5918fe57d27927badf687122/fastapi-0.67.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:31,126 INFO: Downloading: https://files.pythonhosted.org/packages/49/48/26f1b57a5742b364e33ba2908faf794b024658cf26ac340ae692edd4e677/fastapi-0.67.0.tar.gz (mirror.py:875)
2022-11-09 08:23:32,273 INFO: Downloading: https://files.pythonhosted.org/packages/c1/66/5275b973ab5704e47e6735051f30c1e0c827edec2825b84e77cc21c8ba6c/fastapi-0.68.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:32,331 INFO: Downloading: https://files.pythonhosted.org/packages/64/df/939fed987038be2344d1187b666f7ecf172f81d6c9327357ccce05f4e40f/fastapi-0.68.0.tar.gz (mirror.py:875)
2022-11-09 08:23:33,498 INFO: Downloading: https://files.pythonhosted.org/packages/e0/2a/03c3e1ede3aa83c45da1d156b0180288e573f5e2643ec4fd6d697cebebdf/fastapi-0.68.1.tar.gz (mirror.py:875)
2022-11-09 08:23:34,674 INFO: Downloading: https://files.pythonhosted.org/packages/00/6e/4a1dd8aeb5f673f9b772b64a35e7d11e94057306caf3108d52fd47eac7cf/fastapi-0.68.2.tar.gz (mirror.py:875)
2022-11-09 08:23:35,899 INFO: Downloading: https://files.pythonhosted.org/packages/c6/51/7b4d02f3936a4693b871b7b7ae41f19f770c850b54cc5d0b0e98b976e51f/fastapi-0.69.0.tar.gz (mirror.py:875)
2022-11-09 08:23:37,528 INFO: Downloading: https://files.pythonhosted.org/packages/39/c8/4021029cc8a20d83048ec4f9aff57061508a00043590b76164fdf983c674/fastapi-0.7.0.tar.gz (mirror.py:875)
2022-11-09 08:23:38,337 INFO: Downloading: https://files.pythonhosted.org/packages/a3/d2/1d27313c69cfb998521a476931266d84b7bd59d479f7ea6bfbe2d94d9964/fastapi-0.7.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:38,409 INFO: Downloading: https://files.pythonhosted.org/packages/5c/9f/0a27b476708aa6c47abefe74a2ef5db14205bd5938d736e7aea9e6ff6bd1/fastapi-0.7.1.tar.gz (mirror.py:875)
2022-11-09 08:23:39,538 INFO: Downloading: https://files.pythonhosted.org/packages/72/44/a35678119f8a6b25f12224bc55463ecc813c4a0a2c3546818890a50db482/fastapi-0.70.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:39,606 INFO: Downloading: https://files.pythonhosted.org/packages/e6/35/384bc3bf9a4926a45052037e0bf0806ffeda237b8b731cb04a5e1e1c6a45/fastapi-0.70.0.tar.gz (mirror.py:875)
2022-11-09 08:23:40,747 INFO: Downloading: https://files.pythonhosted.org/packages/ad/63/7f0e93e35e2a5e6dd6d3847d2d1cf6da0482cc2cf6ab52fb149c1550fe1d/fastapi-0.70.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:40,796 INFO: Downloading: https://files.pythonhosted.org/packages/90/89/06fe73e915538261626ac4b95b5b8f61938b6150cbed5f9f99c5a16f9719/fastapi-0.70.1.tar.gz (mirror.py:875)
2022-11-09 08:23:42,241 INFO: Downloading: https://files.pythonhosted.org/packages/fe/e9/7bb2bf91b912a6b1fd20e4759742de1b401dad7bf438d9103d3d214f7940/fastapi-0.71.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:42,303 INFO: Downloading: https://files.pythonhosted.org/packages/d7/84/55a906526454816a5d194c8572cb4c4cca8d56f8a1192bf87a9ac101238f/fastapi-0.71.0.tar.gz (mirror.py:875)
2022-11-09 08:23:43,542 INFO: Downloading: https://files.pythonhosted.org/packages/af/d8/34d3939d705060c5a0d714db371cf863568c97f88a059489baa442e79c1a/fastapi-0.72.0.tar.gz (mirror.py:875)
2022-11-09 08:23:44,668 INFO: Downloading: https://files.pythonhosted.org/packages/b3/19/f8a27a1c171aef575aec80aecf0bdbc3880f2f2cb3a190b6cc61efd5617e/fastapi-0.73.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:44,737 INFO: Downloading: https://files.pythonhosted.org/packages/27/a7/439a8891b22b4f1e45483b8a3b209f2eabcfdd44e75c339d5f2d315342fa/fastapi-0.73.0.tar.gz (mirror.py:875)
2022-11-09 08:23:45,836 INFO: Downloading: https://files.pythonhosted.org/packages/2a/d4/6a88d73df0b26b6b00378efe6bbde410377f0d3338834e6c7115e86e858a/fastapi-0.74.0.tar.gz (mirror.py:875)
2022-11-09 08:23:46,914 INFO: Downloading: https://files.pythonhosted.org/packages/c8/ce/07fc3196b05948e16fbc46944728218d4af9a7fb6536e74804c26e303eb8/fastapi-0.74.1.tar.gz (mirror.py:875)
2022-11-09 08:23:48,424 INFO: Downloading: https://files.pythonhosted.org/packages/6d/0b/64ecaddaa9d6d4bbf40422664650f7ec45de9281306c69f22f16f92c510c/fastapi-0.75.0.tar.gz (mirror.py:875)
2022-11-09 08:23:50,707 INFO: Downloading: https://files.pythonhosted.org/packages/cf/63/226c851424ee1a3061e7cff14b9f70e3221b6f33429f8f50e2c98bb30594/fastapi-0.75.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:50,782 INFO: Downloading: https://files.pythonhosted.org/packages/0e/3e/39540da9d0442089c9723c4629657a1d4b17b7fcf260023e3e24c563ce83/fastapi-0.75.1.tar.gz (mirror.py:875)
2022-11-09 08:23:52,041 INFO: Downloading: https://files.pythonhosted.org/packages/a8/68/13f79608112c688a4bc16a4565e1005c362fc61596fad8b962f8fef7cd62/fastapi-0.75.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:52,102 INFO: Downloading: https://files.pythonhosted.org/packages/2c/1c/195178dfef05e6688d9201aca157b5b8a23171dfc685450fba138547d465/fastapi-0.75.2.tar.gz (mirror.py:875)
2022-11-09 08:23:54,060 INFO: Downloading: https://files.pythonhosted.org/packages/d1/94/b7917885697114f5ed4dc2a0839213baefa97256c1516f19d55efceb750e/fastapi-0.76.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:54,122 INFO: Downloading: https://files.pythonhosted.org/packages/7f/6d/9986b5ebbef1872885d9bd76e7ce24def372beddfe5d6e98b5ae36f2e46f/fastapi-0.76.0.tar.gz (mirror.py:875)
2022-11-09 08:23:56,420 INFO: Downloading: https://files.pythonhosted.org/packages/16/3f/6debbab759500c1747d8ecd4c7e6e12891708a9af8e2f89f5cea0a9b9b10/fastapi-0.77.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:56,479 INFO: Downloading: https://files.pythonhosted.org/packages/db/9e/67413d504b1cc044881e7d181c0206a27dd3534fcf6fdf92443477473986/fastapi-0.77.0.tar.gz (mirror.py:875)
2022-11-09 08:23:57,856 INFO: Downloading: https://files.pythonhosted.org/packages/16/5b/d45cca598cec06bead962b84648cbdb0c0d966f2453694bce6f5ce4c0bc9/fastapi-0.77.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:23:57,897 INFO: Downloading: https://files.pythonhosted.org/packages/eb/ab/bdf0fbdbeb1badc95fd1d6510c575457e53efc23c67021684002200e0aa3/fastapi-0.77.1.tar.gz (mirror.py:875)
2022-11-09 08:24:00,374 INFO: Downloading: https://files.pythonhosted.org/packages/61/0f/427f0af121b226e62237e430f5bf4485e0ae1565b3f5b782613b59f30abc/fastapi-0.78.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:00,428 INFO: Downloading: https://files.pythonhosted.org/packages/b7/2a/4676736c3b1864ca483265db43cad9710b83a95c2530aa6bfe671b83fd46/fastapi-0.78.0.tar.gz (mirror.py:875)
2022-11-09 08:24:01,734 INFO: Downloading: https://files.pythonhosted.org/packages/ae/ed/ea37410618f1c206ba857d391d7b2de6de7a758ea586662aef77c945d3b4/fastapi-0.79.0.tar.gz (mirror.py:875)
2022-11-09 08:24:03,087 INFO: Downloading: https://files.pythonhosted.org/packages/48/eb/feec98de25762193702e909535fbf4a1b3cb63617e6ee2e72c95ae4789ba/fastapi-0.79.1.tar.gz (mirror.py:875)
2022-11-09 08:24:04,658 INFO: Downloading: https://files.pythonhosted.org/packages/4d/58/e91d3dc0b12f26ea73891fd07c5b2d8a3492e732fefe506584e24de9d8e3/fastapi-0.8.0.tar.gz (mirror.py:875)
2022-11-09 08:24:06,262 INFO: Downloading: https://files.pythonhosted.org/packages/32/2c/09a806f0e1b715274c50968cf2c9628abe3cedaa117f23ea94884336d528/fastapi-0.80.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:06,324 INFO: Downloading: https://files.pythonhosted.org/packages/82/93/6bd83151004f2188e016589e4e4f48890087cdf84b3a25212216773258f1/fastapi-0.80.0.tar.gz (mirror.py:875)
2022-11-09 08:24:08,182 INFO: Downloading: https://files.pythonhosted.org/packages/cb/3b/f77f6c450882b23343552d06ad09658d14d535dd6b571fa09b8444cb4628/fastapi-0.81.0.tar.gz (mirror.py:875)
2022-11-09 08:24:09,742 INFO: Downloading: https://files.pythonhosted.org/packages/10/95/33ddb2614d59317a18501ef3f598be0e726f2ce7993feadbdf076a9413a1/fastapi-0.82.0.tar.gz (mirror.py:875)
2022-11-09 08:24:11,383 INFO: Downloading: https://files.pythonhosted.org/packages/61/4e/4913c1672374a8161af5e0f865f1a33d8faa185aecaf61b8c288dca1d4fa/fastapi-0.83.0.tar.gz (mirror.py:875)
2022-11-09 08:24:14,267 INFO: Downloading: https://files.pythonhosted.org/packages/60/9a/a41765e60b34af1ba24b7c6dc4d46eb37821cd3a7d616186997b37cb63b2/fastapi-0.84.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:14,315 INFO: Downloading: https://files.pythonhosted.org/packages/6b/1c/e80add75c4c8383d6041a10ca5ee9cdb185ac9d7a8f9ffa94975010e72ca/fastapi-0.84.0.tar.gz (mirror.py:875)
2022-11-09 08:24:16,569 INFO: Downloading: https://files.pythonhosted.org/packages/f8/f6/5334a17a8acb95b2b71825db6c8c3d2b984d1d0c31266fcda02480ab62ab/fastapi-0.85.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:16,642 INFO: Downloading: https://files.pythonhosted.org/packages/f2/74/15805b9921c0fa99a732bbab71fc548a269d027b6540f48043f87338a273/fastapi-0.85.0.tar.gz (mirror.py:875)
2022-11-09 08:24:19,785 INFO: Downloading: https://files.pythonhosted.org/packages/bf/54/6eb1882b5cb29e6647df92ee74d0a93dab149234ec914563cab955fa667f/fastapi-0.85.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:19,857 INFO: Downloading: https://files.pythonhosted.org/packages/76/06/167f461067a95fb631fdf65657089364dc43844bc38d8c39374c3abbc746/fastapi-0.85.1.tar.gz (mirror.py:875)
2022-11-09 08:24:21,678 INFO: Downloading: https://files.pythonhosted.org/packages/99/d4/4256804791b1e822f46bf79015270e9e9f14e9b634cb8231a88f6dc100c3/fastapi-0.85.2-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:21,762 INFO: Downloading: https://files.pythonhosted.org/packages/f9/7a/8a2cd82257017a4c15f13a8e831bc22c52cc0a3e9fad5a2cc00c491e733f/fastapi-0.85.2.tar.gz (mirror.py:875)
2022-11-09 08:24:23,508 INFO: Downloading: https://files.pythonhosted.org/packages/7b/d6/aa8078112b5bd15b716bb431b25f00e5befc23a05cb3fa66ca4e425b6682/fastapi-0.86.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:23,577 INFO: Downloading: https://files.pythonhosted.org/packages/3d/c4/0cbe3b1213cdb4b3dd8692ed30788b01bf49d88d71afcb1c296a608f6029/fastapi-0.86.0.tar.gz (mirror.py:875)
2022-11-09 08:24:25,363 INFO: Downloading: https://files.pythonhosted.org/packages/cf/fe/1b987eb94099504630e3c3dcb324e803466f1afd96ff33cb1ae7b2652cc4/fastapi-0.9.0-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:25,447 INFO: Downloading: https://files.pythonhosted.org/packages/d7/2b/08583e9aeaacde54a1bc814a29916e390ebd36f7d54d53e9ef5b3236d21c/fastapi-0.9.0.tar.gz (mirror.py:875)
2022-11-09 08:24:26,315 INFO: Downloading: https://files.pythonhosted.org/packages/f4/0e/17e5aba8ee34c2175689b1064d84b4050d2a530afdf8ca13c186a47e6b1a/fastapi-0.9.1-py3-none-any.whl (mirror.py:875)
2022-11-09 08:24:26,804 INFO: Downloading: https://files.pythonhosted.org/packages/98/c7/5c98837ca82d4e49c16891100724328931bd07b79e61528291bbf94436bb/fastapi-0.9.1.tar.gz (mirror.py:875)
2022-11-09 08:24:26,821 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/98/c7/5c98837ca82d4e49c16891100724328931bd07b79e61528291bbf94436bb/fastapi-0.9.1.tar.gz (mirror.py:686)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/98/c7/5c98837ca82d4e49c16891100724328931bd07b79e61528291bbf94436bb'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/98/c7/5c98837ca82d4e49c16891100724328931bd07b79e61528291bbf94436bb'
2022-11-09 08:24:26,823 ERROR: Error syncing package: fastapi@15646760 (mirror.py:377)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 130, in package_syncer
    await self.process_package(package)
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 337, in process_package
    await self.sync_release_files(package)
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 693, in sync_release_files
    raise deferred_exception  # raise the exception after trying all files
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files
    downloaded_file = await self.download_file(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file
    dirname.mkdir(parents=True)
  File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir
    self.mkdir(mode, parents=False, exist_ok=exist_ok)
  File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir
    self._accessor.mkdir(self, mode)
FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3'
2022-11-09 08:24:26,824 INFO: Generating global index page. (simple.py:223)
2022-11-09 08:24:27,010 INFO: 2 packages had changes (mirror.py:990)
2022-11-09 08:24:27,010 INFO: Writing diff file to mirrored-files (mirror.py:1000)

It seems there are now more error messages. The file system is overlay from docker (desktop). Below that is a APFS (Apple). Happy to help debugging.

cooperlees commented 2 years ago

Yeah, this definitely looks like a bug. I've never tested Docker on non Linux. But I do have a apple to try repro on ... But I'm low on time. Will try find some time in the coming weeks to see if I can repro and work this out.

What confuses me here is where we're getting two extensions we're getting this:

FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3'

and

FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/c4/3d/2f36f343b2927f2bcef8707510a8560dc07f76a2da95c1c3274942d7a1e3'

I wonder if we have to do some more fancier things (maybe call fsync) with overlayfs?

If you have time, can you try change your workers to 1 (so you only download 1 at a time) and see if the problem persists ...

tibeer commented 2 years ago

I reduced the worker amount to 1. Unfortunately the issue persists. Logs below :)

Expand me ``` user@machine pip % docker exec -it pip-bandersnatch-1 bandersnatch -c /conf/bandersnatch.conf mirror 2022-11-11 11:10:54,897 INFO: Selected storage backend: filesystem (configuration.py:131) 2022-11-11 11:10:54,899 INFO: Selected compare method: hash (configuration.py:177) 2022-11-11 11:10:55,566 INFO: Initialized project plugin allowlist_project, filtering ['typer', 'fastapi', 'docker'] (allowlist_name.py:31) 2022-11-11 11:10:55,751 INFO: Status file /srv/pypi/status missing. Starting over. (mirror.py:566) 2022-11-11 11:10:55,751 INFO: Syncing with https://pypi.org. (mirror.py:57) 2022-11-11 11:10:55,752 INFO: Current mirror serial: 0 (mirror.py:278) 2022-11-11 11:10:55,752 INFO: Syncing all packages. (mirror.py:293) 2022-11-11 11:11:29,540 INFO: Package 'typer' is allowlisted (allowlist_name.py:88) 2022-11-11 11:11:29,862 INFO: Package 'fastapi' is allowlisted (allowlist_name.py:88) 2022-11-11 11:11:29,867 INFO: Package 'docker' is allowlisted (allowlist_name.py:88) 2022-11-11 11:11:36,242 INFO: Trying to reach serial: 15734540 (mirror.py:310) 2022-11-11 11:11:36,243 INFO: 3 packages to sync. (mirror.py:312) 2022-11-11 11:11:36,283 INFO: No metadata filters are enabled. Skipping metadata filtering (mirror.py:76) 2022-11-11 11:11:36,284 INFO: No release filters are enabled. Skipping release filtering (mirror.py:78) 2022-11-11 11:11:36,284 INFO: No release file filters are enabled. Skipping release file filtering (mirror.py:80) 2022-11-11 11:11:36,286 INFO: Fetching metadata for package: docker (serial 15631690) (package.py:58) 2022-11-11 11:11:39,379 INFO: Storing index page(s): docker - in /srv/pypi/web/simple/docker (mirror.py:698) 2022-11-11 11:11:39,431 INFO: Fetching metadata for package: fastapi (serial 15646760) (package.py:58) 2022-11-11 11:11:49,346 INFO: Downloading: https://files.pythonhosted.org/packages/c8/37/9931d412ba3132f2c4332682e0b8bb8ddc0f60471e0a8d6896fa45c73f1c/fastapi-0.20.0.tar.gz (mirror.py:875) 2022-11-11 11:11:50,374 INFO: Downloading: https://files.pythonhosted.org/packages/ba/9a/c1a0504028822ec649a45b52dce11d25b60d7a4b93510a39c9e41435fdc2/fastapi-0.20.1.tar.gz (mirror.py:875) 2022-11-11 11:11:51,166 INFO: Downloading: https://files.pythonhosted.org/packages/52/46/76fc59fd9b472efbc6b00a537b061c22db8ee2b249e87a1ee5c8e9eff306/fastapi-0.21.0.tar.gz (mirror.py:875) 2022-11-11 11:11:52,014 INFO: Downloading: https://files.pythonhosted.org/packages/2c/1d/bcf27e8f99a716cc60dfc9c1258d90d82f05b6c650d2c768eb2ae71d9b63/fastapi-0.22.0.tar.gz (mirror.py:875) 2022-11-11 11:11:52,854 INFO: Downloading: https://files.pythonhosted.org/packages/5e/58/3eeecfc9acb2a5d79b4b523d6cc6f97f122a5ead5ad366f01e750036a74e/fastapi-0.23.0.tar.gz (mirror.py:875) 2022-11-11 11:11:54,650 INFO: Downloading: https://files.pythonhosted.org/packages/71/48/64f0a29bd601a90e323562547a6989db221ad5f69c77e0b7565f8ec477d0/fastapi-0.24.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:11:54,715 INFO: Downloading: https://files.pythonhosted.org/packages/9c/85/d38aa42a29231906bb559cca8bb2f032f170bfbf647fe446bc90258294ba/fastapi-0.24.0.tar.gz (mirror.py:875) 2022-11-11 11:11:55,518 INFO: Downloading: https://files.pythonhosted.org/packages/b7/48/6a691a87c3eb8638e2e6adb8e1a0e34d35067122a63db29e8c2b435ff3e0/fastapi-0.25.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:11:55,525 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/b7/48/6a691a87c3eb8638e2e6adb8e1a0e34d35067122a63db29e8c2b435ff3e0/fastapi-0.25.0-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/b7/48/6a691a87c3eb8638e2e6adb8e1a0e34d35067122a63db29e8c2b435ff3e0' 2022-11-11 11:11:55,532 INFO: Downloading: https://files.pythonhosted.org/packages/50/16/a7b8f7cdb679e8f81547e0f9d6d9049815a5cbf187738a60be6e682e0089/fastapi-0.25.0.tar.gz (mirror.py:875) 2022-11-11 11:11:57,133 INFO: Downloading: https://files.pythonhosted.org/packages/ad/df/6d757dab8ea480be15f5b600ee90aaf149c16a3780b8cd50bc749f65fdf1/fastapi-0.26.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:11:57,215 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/ad/df/6d757dab8ea480be15f5b600ee90aaf149c16a3780b8cd50bc749f65fdf1/fastapi-0.26.0-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 911, in download_file self.storage_backend.set_upload_time(path, upload_time) File "/usr/local/lib/python3.10/site-packages/bandersnatch_storage_plugins/filesystem.py", line 288, in set_upload_time os.utime(path, (ts, ts)) PermissionError: [Errno 1] Operation not permitted 2022-11-11 11:11:57,220 INFO: Downloading: https://files.pythonhosted.org/packages/db/a2/8683239773f12c1f97ffd2d76223882a5ecd86abfabc45ceb078d1b668f2/fastapi-0.26.0.tar.gz (mirror.py:875) 2022-11-11 11:11:59,779 INFO: Downloading: https://files.pythonhosted.org/packages/48/6a/78cecd90b1fc4e62408a53ae4e6de1daa21762c0e1f251fb8a26e2ad061b/fastapi-0.27.2.tar.gz (mirror.py:875) 2022-11-11 11:12:00,602 INFO: Downloading: https://files.pythonhosted.org/packages/e6/b1/cec35fe22b1f15afabf5d02f7b3c3885dacf6cc5364f14ffa58da7febfbc/fastapi-0.28.0.tar.gz (mirror.py:875) 2022-11-11 11:12:01,390 INFO: Downloading: https://files.pythonhosted.org/packages/fb/2a/32279b88584b345333581974843820d0bb8a8ecf956b065a013138362a59/fastapi-0.29.0.tar.gz (mirror.py:875) 2022-11-11 11:12:02,826 INFO: Downloading: https://files.pythonhosted.org/packages/c6/75/6949c65017ec6bc402f734ac94eefebc2d1aeb8142682904ae96dd4b271e/fastapi-0.29.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:02,893 INFO: Downloading: https://files.pythonhosted.org/packages/6c/6a/6bca3022a045066fa2e64eca6b64a6ddc1fe6e2b753fc39128b46df6678b/fastapi-0.29.1.tar.gz (mirror.py:875) 2022-11-11 11:12:04,202 INFO: Downloading: https://files.pythonhosted.org/packages/bb/56/c1f277ba279e3459e39107429a10833ed2745b26077f6ff8bb84c3b069d7/fastapi-0.3.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:04,270 INFO: Downloading: https://files.pythonhosted.org/packages/3e/5a/bd109788bf5c76661511bc51ac1c3b67f5040f9579ebc10bd31559f5e5f9/fastapi-0.3.0.tar.gz (mirror.py:875) 2022-11-11 11:12:04,874 INFO: Downloading: https://files.pythonhosted.org/packages/45/e0/0c777f9c2705140490617b172c9bc5c0b79f2816bb882719bb472498741e/fastapi-0.30.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:04,951 INFO: Downloading: https://files.pythonhosted.org/packages/3c/16/f389a874e9a1235227c1c20e709c5503a0621195796286492599d7bd87df/fastapi-0.30.0.tar.gz (mirror.py:875) 2022-11-11 11:12:05,773 INFO: Downloading: https://files.pythonhosted.org/packages/f9/f3/6ecd806db796606431a78de4eff9edcf42f788ff653e9acf4c7f6057c38f/fastapi-0.30.1.tar.gz (mirror.py:875) 2022-11-11 11:12:06,565 INFO: Downloading: https://files.pythonhosted.org/packages/3d/4e/7ea13b3e4c0590b57d8138041cfb511dd2b450f97316f138951348851dc0/fastapi-0.31.0.tar.gz (mirror.py:875) 2022-11-11 11:12:07,329 INFO: Downloading: https://files.pythonhosted.org/packages/d1/ce/2e59c0404fce6237d2fc99df0858459ea605238d16e45720a64824f8851c/fastapi-0.32.0.tar.gz (mirror.py:875) 2022-11-11 11:12:08,565 INFO: Downloading: https://files.pythonhosted.org/packages/52/78/0289b14c64d819ad49ef28c8453a3906ef6a19b0f1d977f0334066c01681/fastapi-0.33.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:08,639 INFO: Downloading: https://files.pythonhosted.org/packages/94/01/9fdade622c17ebe2f24dd32df87ae8cd69dc5d6046eb2fec5f5a9c6fdefe/fastapi-0.33.0.tar.gz (mirror.py:875) 2022-11-11 11:12:10,553 INFO: Downloading: https://files.pythonhosted.org/packages/45/9e/483c79a63ca3062cc844442b1e88293dcf524ca724742538f036e617dca1/fastapi-0.34.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:10,625 INFO: Downloading: https://files.pythonhosted.org/packages/d8/bd/b4083b9f38a3f62dbb3dca2d7094d5941efdbff39ca1b57da3364da0dfb1/fastapi-0.34.0.tar.gz (mirror.py:875) 2022-11-11 11:12:11,496 INFO: Downloading: https://files.pythonhosted.org/packages/67/35/259ef7a337036fbe21be0748515481f0f7dd328100db27c7e3e2acebbe8d/fastapi-0.35.0.tar.gz (mirror.py:875) 2022-11-11 11:12:12,201 INFO: Downloading: https://files.pythonhosted.org/packages/bb/94/7b5953d610858b0d0324b849e13cdf97bef476a27d8d8ca3494c35a6eb54/fastapi-0.36.0.tar.gz (mirror.py:875) 2022-11-11 11:12:13,618 INFO: Downloading: https://files.pythonhosted.org/packages/7b/1e/e033a6c57355eb16e29fe7220911f3a4a87fe163b5674a29eb758e33e428/fastapi-0.37.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:13,745 INFO: Downloading: https://files.pythonhosted.org/packages/34/12/093fe39888016473561d302327a013301a4ca8b9509c7a6b9af26aecfdd0/fastapi-0.37.0.tar.gz (mirror.py:875) 2022-11-11 11:12:15,770 INFO: Downloading: https://files.pythonhosted.org/packages/a0/f0/e5a727d256ddaaddb37493cd182fcf2d2feffe04ffbc06194cd57e6bbcdf/fastapi-0.38.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:15,870 INFO: Downloading: https://files.pythonhosted.org/packages/1b/f5/595bb169d0d85f7d3811fcf268c0872a05cb48cdd1ac1e0a14b063de3972/fastapi-0.38.0.tar.gz (mirror.py:875) 2022-11-11 11:12:15,914 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/1b/f5/595bb169d0d85f7d3811fcf268c0872a05cb48cdd1ac1e0a14b063de3972/fastapi-0.38.0.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/1b/f5/595bb169d0d85f7d3811fcf268c0872a05cb48cdd1ac1e0a14b063de3972' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/1b/f5/595bb169d0d85f7d3811fcf268c0872a05cb48cdd1ac1e0a14b063de3972' 2022-11-11 11:12:15,921 INFO: Downloading: https://files.pythonhosted.org/packages/37/59/1a42dde38f1ae2a7a318947e54fabd1fc02ac423ecc91957c417065e7cc6/fastapi-0.38.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:16,006 INFO: Downloading: https://files.pythonhosted.org/packages/af/63/76229a4268091757dfce3f63487e8c9b92639c30a8396757679e3a20c6b6/fastapi-0.38.1.tar.gz (mirror.py:875) 2022-11-11 11:12:16,814 INFO: Downloading: https://files.pythonhosted.org/packages/81/c8/28222022dada4209428ae6e4d6e2ec170872696c10eaec66d4dc792572b3/fastapi-0.39.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:16,890 INFO: Downloading: https://files.pythonhosted.org/packages/8b/20/eb050de401ef0a302f20452e123af841af47306b034f9044c279ae5b37d3/fastapi-0.39.0.tar.gz (mirror.py:875) 2022-11-11 11:12:17,951 INFO: Downloading: https://files.pythonhosted.org/packages/5f/a6/8700fefc54d819b97c259b99e510298041cd6de7571f58f6054ed0474100/fastapi-0.4.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:18,031 INFO: Downloading: https://files.pythonhosted.org/packages/8c/65/12ba1e298bca05dc2109f96c35c4a54c5aeadeb81e9fd88ebbead9cb7bdd/fastapi-0.4.0.tar.gz (mirror.py:875) 2022-11-11 11:12:19,026 INFO: Downloading: https://files.pythonhosted.org/packages/b4/6f/2ba55d2571e9dd97896695bcefc7f30c26e1d5c09d12caec925680235c39/fastapi-0.40.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:19,104 INFO: Downloading: https://files.pythonhosted.org/packages/c4/cd/685523fc953335ac62dd4ceb9347994a85b768d2b32d1d829ce82e8048dd/fastapi-0.40.0.tar.gz (mirror.py:875) 2022-11-11 11:12:20,884 INFO: Downloading: https://files.pythonhosted.org/packages/fc/08/968e7acf9619a93aa7e9570f4bf31aee0aef46d1b6caeb7ae8c53c626f37/fastapi-0.41.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:20,966 INFO: Downloading: https://files.pythonhosted.org/packages/6e/31/5f3b44f0f572c523e78a05bf2bca155466b95e4746ad5a4d500736b86f9c/fastapi-0.41.0.tar.gz (mirror.py:875) 2022-11-11 11:12:23,149 INFO: Downloading: https://files.pythonhosted.org/packages/4a/28/97c3b661e7bebe8508a58343c4242603d75773c18199d719c2cfd8b8428b/fastapi-0.42.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:23,228 INFO: Downloading: https://files.pythonhosted.org/packages/90/31/099a3abb5d43db1a0fc29144e4dd8681ca33a6005473fd315ff364c6e5c6/fastapi-0.42.0.tar.gz (mirror.py:875) 2022-11-11 11:12:25,190 INFO: Downloading: https://files.pythonhosted.org/packages/76/93/7986f027577782162a448b66353cd7050d27138b77262b1de1f723cc59ce/fastapi-0.43.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:25,282 INFO: Downloading: https://files.pythonhosted.org/packages/b9/73/c59aca57ed410d531ca31cda428c6e03c1c07bdc466cd3b5d3dbebc5fdfc/fastapi-0.43.0.tar.gz (mirror.py:875) 2022-11-11 11:12:26,828 INFO: Downloading: https://files.pythonhosted.org/packages/ea/24/d65623a36f970764797edb4b4bbe8d9166f4911a28371410d01bd6ef0cd6/fastapi-0.44.0.tar.gz (mirror.py:875) 2022-11-11 11:12:27,793 INFO: Downloading: https://files.pythonhosted.org/packages/66/9e/cf4837c3cc4d96caddf97a2974c8bb02204ffae7fc9c0ceaff9c21cf3c49/fastapi-0.44.1.tar.gz (mirror.py:875) 2022-11-11 11:12:28,778 INFO: Downloading: https://files.pythonhosted.org/packages/ce/eb/93adebcaf0ddddc4d185520d6bad5c00d2b3b5f70abe15ac16555e3a5b50/fastapi-0.45.0.tar.gz (mirror.py:875) 2022-11-11 11:12:29,594 INFO: Downloading: https://files.pythonhosted.org/packages/b4/cc/44941903f220aad11f7252d729dc32a7cb2ec20d4ffd78053abea4a4d050/fastapi-0.46.0.tar.gz (mirror.py:875) 2022-11-11 11:12:31,418 INFO: Downloading: https://files.pythonhosted.org/packages/c7/67/d489088f26e9d4846043cc15160dcabba117474ee6b76c7db7fb215f7c71/fastapi-0.47.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:31,463 INFO: Downloading: https://files.pythonhosted.org/packages/de/b1/cca52dc8e2bbf91d4e411bc87f3160cc5f6856e75a9e0b081fef25bc77ac/fastapi-0.47.0.tar.gz (mirror.py:875) 2022-11-11 11:12:33,251 INFO: Downloading: https://files.pythonhosted.org/packages/a3/a7/4804d7abf8a1544d079d50650af872387154ebdac5bd07d54b2e60e2b334/fastapi-0.47.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:33,302 INFO: Downloading: https://files.pythonhosted.org/packages/24/98/4fc080a7caafd79deb3abdd899be45337e78e6768aba08678aee7c4edfc3/fastapi-0.47.1.tar.gz (mirror.py:875) 2022-11-11 11:12:33,317 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/24/98/4fc080a7caafd79deb3abdd899be45337e78e6768aba08678aee7c4edfc3/fastapi-0.47.1.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/24/98/4fc080a7caafd79deb3abdd899be45337e78e6768aba08678aee7c4edfc3' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/24/98/4fc080a7caafd79deb3abdd899be45337e78e6768aba08678aee7c4edfc3' 2022-11-11 11:12:33,321 INFO: Downloading: https://files.pythonhosted.org/packages/7b/1a/c53cf201d35cc1bb69fd2f5af9976cb12c2f0156c4662d61ce5c22c76ded/fastapi-0.48.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:33,390 INFO: Downloading: https://files.pythonhosted.org/packages/37/d9/679462f5d48458afc8afcc3c8cc62177843aaafb416162666c3fa7b162f3/fastapi-0.48.0.tar.gz (mirror.py:875) 2022-11-11 11:12:35,318 INFO: Downloading: https://files.pythonhosted.org/packages/b4/0c/d7ce15c837486502ae146aec1caab3515d6fa434ae2554d88e3d589f180a/fastapi-0.49.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:35,374 INFO: Downloading: https://files.pythonhosted.org/packages/10/7e/691edfb8fc0bc7f201be0dcd92f58836a57abffe3dee10d24adb301c6da7/fastapi-0.49.0.tar.gz (mirror.py:875) 2022-11-11 11:12:37,205 INFO: Downloading: https://files.pythonhosted.org/packages/2f/57/ad36eb7f47c463e3bf5ec57874c14469b6065b1ab2d510f7b2b4219f9148/fastapi-0.49.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:37,263 INFO: Downloading: https://files.pythonhosted.org/packages/db/fd/3d6b6a70892784f7bfba11a3755d7271613d0f0db438dfb4b001f39f21d0/fastapi-0.49.1.tar.gz (mirror.py:875) 2022-11-11 11:12:38,146 INFO: Downloading: https://files.pythonhosted.org/packages/b8/2a/13ca48d28a51ebad2f0e12f9084252ac02d60e7c207737c5fae5d1639d0e/fastapi-0.49.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:38,181 INFO: Downloading: https://files.pythonhosted.org/packages/c7/97/b0fc25252a3d74c27e392505660ed1d9e36f116a2783dfccd692c759c3b3/fastapi-0.49.2.tar.gz (mirror.py:875) 2022-11-11 11:12:39,775 INFO: Downloading: https://files.pythonhosted.org/packages/c3/31/127290b5be5e72423e8937506830964b50e818a2039db3ec1d46b0abade7/fastapi-0.5.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:39,841 INFO: Downloading: https://files.pythonhosted.org/packages/e4/27/eb1e323b2eb60dab88d93ec6dae4f76970b1e441a70d8573e030ae0da02c/fastapi-0.5.0.tar.gz (mirror.py:875) 2022-11-11 11:12:40,996 INFO: Downloading: https://files.pythonhosted.org/packages/62/20/6f9895adaf7a5c9005eed6c6a6855bf0a39507037b03571dc9285ce16af1/fastapi-0.5.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:41,053 INFO: Downloading: https://files.pythonhosted.org/packages/3e/08/1ac8eda55669cd5c2b2fd343ee81e460cf6a24f49368fd7de28c0c0a6023/fastapi-0.5.1.tar.gz (mirror.py:875) 2022-11-11 11:12:42,734 INFO: Downloading: https://files.pythonhosted.org/packages/91/56/20f373a15e83e429fbbbf5e09357dde46cb9171f89e76e0ee3eaf4fc3578/fastapi-0.50.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:42,775 INFO: Downloading: https://files.pythonhosted.org/packages/82/fd/f967d9845c85d475e1a3fe228ae72b04e0dcb615638b8b2e10f794f825ff/fastapi-0.50.0.tar.gz (mirror.py:875) 2022-11-11 11:12:44,567 INFO: Downloading: https://files.pythonhosted.org/packages/e7/dc/930093c07ef0ce8fa960139bbbc6cf0b2b4343c5b0faf4222e2e7afa826a/fastapi-0.51.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:44,621 INFO: Downloading: https://files.pythonhosted.org/packages/d8/a4/a192938c358ba12043fb5f34ef9319d4ba776c53bfc4bd893c0d21fdbd9e/fastapi-0.51.0.tar.gz (mirror.py:875) 2022-11-11 11:12:46,583 INFO: Downloading: https://files.pythonhosted.org/packages/18/5b/46c084c174fc69b2a7e1d9c22d014f39fb677d9a7635f24734ef56e0fb53/fastapi-0.52.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:46,636 INFO: Downloading: https://files.pythonhosted.org/packages/7f/3a/d19b7af86f61877c2d976b3b220ae8b2b22c45fa8f0d0787e9f32d40fcc2/fastapi-0.52.0.tar.gz (mirror.py:875) 2022-11-11 11:12:48,620 INFO: Downloading: https://files.pythonhosted.org/packages/f9/eb/f899ccd1f052bb306d3938696458a403ee61a116fd784bc9fb266f6ce211/fastapi-0.53.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:48,681 INFO: Downloading: https://files.pythonhosted.org/packages/ee/fa/a9bdf3410669cb2f10e9fe4e11d1ae13338ed7947745e8b3797a6bff5c8a/fastapi-0.53.0.tar.gz (mirror.py:875) 2022-11-11 11:12:49,594 INFO: Downloading: https://files.pythonhosted.org/packages/cb/19/5bb41e0f33413cf768a63451945a2166ca76c14d4a42f79c7b628d7bfaae/fastapi-0.53.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:49,630 INFO: Downloading: https://files.pythonhosted.org/packages/fd/1c/752cee1610bea575e60fa975ff3d5b535ede94a7742da6f43b9b5c3f6da8/fastapi-0.53.1.tar.gz (mirror.py:875) 2022-11-11 11:12:51,913 INFO: Downloading: https://files.pythonhosted.org/packages/f7/6b/d7c462d6dbf9460981389b02045bdf730f55e079c3497f197db44fef14e4/fastapi-0.53.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:51,983 INFO: Downloading: https://files.pythonhosted.org/packages/e3/aa/d807237eca90e3a1f49139407eda6d7a380a77a6747b1c37265bf7ecf43f/fastapi-0.53.2.tar.gz (mirror.py:875) 2022-11-11 11:12:53,754 INFO: Downloading: https://files.pythonhosted.org/packages/f6/26/fe0ef3f1ba5b0b2264da858a4407ed1fcd94f49655281487e6bd2709a8b7/fastapi-0.54.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:53,823 INFO: Downloading: https://files.pythonhosted.org/packages/f7/b9/6aad3271f8171bc098bf8a184c03d8c376ca6fb6b01a63484d37c17f9f60/fastapi-0.54.0.tar.gz (mirror.py:875) 2022-11-11 11:12:55,767 INFO: Downloading: https://files.pythonhosted.org/packages/4d/54/45770888a4a73666390120b444131568637e70b5e002860bad99fa1dcb27/fastapi-0.54.1.tar.gz (mirror.py:875) 2022-11-11 11:12:56,675 INFO: Downloading: https://files.pythonhosted.org/packages/be/a9/28297b80b3573662af8ae205c162362aa6a5308dc4ba9e381471590d9b96/fastapi-0.54.2.tar.gz (mirror.py:875) 2022-11-11 11:12:57,567 INFO: Downloading: https://files.pythonhosted.org/packages/29/7f/013c7f28edd70f8825d3e95b8d19467a151cd698977a0f0a36a04110475c/fastapi-0.55.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:57,623 INFO: Downloading: https://files.pythonhosted.org/packages/bf/40/37def65cd25fc032e1b555ed8038d62a3d77613a5c47bc03311e1a9859c7/fastapi-0.55.0.tar.gz (mirror.py:875) 2022-11-11 11:12:57,643 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/bf/40/37def65cd25fc032e1b555ed8038d62a3d77613a5c47bc03311e1a9859c7/fastapi-0.55.0.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/bf/40/37def65cd25fc032e1b555ed8038d62a3d77613a5c47bc03311e1a9859c7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/bf/40/37def65cd25fc032e1b555ed8038d62a3d77613a5c47bc03311e1a9859c7' 2022-11-11 11:12:57,646 INFO: Downloading: https://files.pythonhosted.org/packages/05/24/29cf80ab90b921fc245118762afc67e561b591a6b8b9523f650a2ddf59e5/fastapi-0.55.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:57,711 INFO: Downloading: https://files.pythonhosted.org/packages/0a/13/785d0e5967128628f1d6c05ba16d4c9bf9506d7fd35bbe5b2e269d2804ab/fastapi-0.55.1.tar.gz (mirror.py:875) 2022-11-11 11:12:59,532 INFO: Downloading: https://files.pythonhosted.org/packages/bd/0e/f313c9973973b74aef39397ce2b3e6c8d4e6e0172da43499ea80692d20b8/fastapi-0.56.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:12:59,580 INFO: Downloading: https://files.pythonhosted.org/packages/bc/81/1caf557ef8e721c45bb77258eb4dfda715f99bc90dbed2d59e66e5a4c545/fastapi-0.56.0.tar.gz (mirror.py:875) 2022-11-11 11:13:01,098 INFO: Downloading: https://files.pythonhosted.org/packages/10/1b/6995baf88eaf291cd20e6b3a9eaab13173746bd39591e9d0faf25db5469b/fastapi-0.56.1.tar.gz (mirror.py:875) 2022-11-11 11:13:02,020 INFO: Downloading: https://files.pythonhosted.org/packages/c0/c7/b677cf5f42b09b02d8562d5d39fdec2c777966f4ba1d150885333d94aaa8/fastapi-0.57.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:02,060 INFO: Downloading: https://files.pythonhosted.org/packages/55/fe/c4f3d3f4056ed63ec0d852746529f05a9afe740c51bdc23ac037042ebc1b/fastapi-0.57.0.tar.gz (mirror.py:875) 2022-11-11 11:13:03,014 INFO: Downloading: https://files.pythonhosted.org/packages/0a/26/754130d8f3c85f56e98758e91bd848d50389f215cf46e5d08689adb1b9ab/fastapi-0.58.0.tar.gz (mirror.py:875) 2022-11-11 11:13:03,957 INFO: Downloading: https://files.pythonhosted.org/packages/a2/56/ddcc6a9c03592e3d447d74bf0057e35d244b3882f82a25899f6988a308ed/fastapi-0.58.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:03,994 INFO: Downloading: https://files.pythonhosted.org/packages/b0/47/a46950e883896d0280f13a4dd5b8bef2c72ebe9fd5509e360c19e2d181bf/fastapi-0.58.1.tar.gz (mirror.py:875) 2022-11-11 11:13:05,755 INFO: Downloading: https://files.pythonhosted.org/packages/31/24/8586a2a6ec815df9a8ac1296a4c7910314307ad3144e620af29bb77b7180/fastapi-0.59.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:05,802 INFO: Downloading: https://files.pythonhosted.org/packages/9f/c2/31ae21414301c60d0bbb83676d843aa303f2e3bc47987cb471438e8b30b6/fastapi-0.59.0.tar.gz (mirror.py:875) 2022-11-11 11:13:06,765 INFO: Downloading: https://files.pythonhosted.org/packages/fe/1a/8e2b46d2e35c08102e022f900da6d4e6567533ac1179329ac858795814b5/fastapi-0.6.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:06,813 INFO: Downloading: https://files.pythonhosted.org/packages/c9/68/f9606baa28ff12e65a55ffc76d6978f42e41a8166baa5678822d32cc60b7/fastapi-0.6.0.tar.gz (mirror.py:875) 2022-11-11 11:13:07,441 INFO: Downloading: https://files.pythonhosted.org/packages/27/1c/d76eeb84acb0c7fba81a741f205f19368aaeb7b5f512e1591ecbf92971b6/fastapi-0.6.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:07,520 INFO: Downloading: https://files.pythonhosted.org/packages/db/ff/19c04ede806ff37de2a64590daae0d2bf3fda0be2068eb475a258503b217/fastapi-0.6.1.tar.gz (mirror.py:875) 2022-11-11 11:13:08,847 INFO: Downloading: https://files.pythonhosted.org/packages/2c/a4/5be495c24d80e5f0117182a836cd04c10026b38349f386d4ad7d908852e0/fastapi-0.6.2.tar.gz (mirror.py:875) 2022-11-11 11:13:09,521 INFO: Downloading: https://files.pythonhosted.org/packages/52/ef/3f770b61e25e3863fb0199014b1099728a2d6c887bb9bd59f0383e8333b9/fastapi-0.6.3.tar.gz (mirror.py:875) 2022-11-11 11:13:10,266 INFO: Downloading: https://files.pythonhosted.org/packages/5e/36/d6a12c5532a31b072f69674cb55f52c911410a60ef40687f2a9f06bfbc4f/fastapi-0.6.4.tar.gz (mirror.py:875) 2022-11-11 11:13:10,993 INFO: Downloading: https://files.pythonhosted.org/packages/b0/f7/6abe5e057df3afcaa0566903ae8d60ecad64a13599e937254f23b49e7ea2/fastapi-0.60.0.tar.gz (mirror.py:875) 2022-11-11 11:13:11,907 INFO: Downloading: https://files.pythonhosted.org/packages/83/08/3d0113f3c4c0ad650ca438d583187af434f7136843c3ed04216866db21d4/fastapi-0.60.1.tar.gz (mirror.py:875) 2022-11-11 11:13:12,812 INFO: Downloading: https://files.pythonhosted.org/packages/30/1a/0346ce8f8146d6f74d91ad15429f8bee32b7eecc500efae401fcd2578acd/fastapi-0.60.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:12,867 INFO: Downloading: https://files.pythonhosted.org/packages/ac/bc/9ec5a7400d02df102d15b53f689993ba491a11b5cfc86c90a4accb019195/fastapi-0.60.2.tar.gz (mirror.py:875) 2022-11-11 11:13:13,799 INFO: Downloading: https://files.pythonhosted.org/packages/82/cb/96cb7cc6a807af493f0083e7d854fdd568ae5335f8f93b96c966fabd8d2f/fastapi-0.61.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:13,856 INFO: Downloading: https://files.pythonhosted.org/packages/ac/af/e10003597b5dd7a98add4b208be133161e0d886db203eca733dbe3b200b2/fastapi-0.61.0.tar.gz (mirror.py:875) 2022-11-11 11:13:14,783 INFO: Downloading: https://files.pythonhosted.org/packages/48/65/454fb440d48098845875b5ba8599efafee1efabb97720a584c78674e6d26/fastapi-0.61.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:14,851 INFO: Downloading: https://files.pythonhosted.org/packages/da/32/ea2b86e56674ff3d1bb0bbb2e3b74a04694ac0be3331e9f9d431c350bcc2/fastapi-0.61.1.tar.gz (mirror.py:875) 2022-11-11 11:13:15,772 INFO: Downloading: https://files.pythonhosted.org/packages/4c/0b/5df17eaadb7fe39dad349f484e551e802ce0581be672822f010c530d5e75/fastapi-0.61.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:15,834 INFO: Downloading: https://files.pythonhosted.org/packages/36/0c/888ebd0cdef9045b811c3e06b3860742a41d4b9699ba4e0b81fa82d9d817/fastapi-0.61.2.tar.gz (mirror.py:875) 2022-11-11 11:13:18,192 INFO: Downloading: https://files.pythonhosted.org/packages/7f/5b/23057d0cdeac3643c08937ef1348590e284842636c837108971d8af6b51d/fastapi-0.63.0.tar.gz (mirror.py:875) 2022-11-11 11:13:19,366 INFO: Downloading: https://files.pythonhosted.org/packages/a1/fe/064bdb5598ad9dfe942b58884296bcd7b81d1e13e5af48fd328e38b2de97/fastapi-0.64.0.tar.gz (mirror.py:875) 2022-11-11 11:13:20,346 INFO: Downloading: https://files.pythonhosted.org/packages/2c/2a/4b5dcc2eabaa439f81387b0d3f80ebb2ea52b0436720b713fef79db32b7e/fastapi-0.65.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:20,406 INFO: Downloading: https://files.pythonhosted.org/packages/8d/31/eb754cf36c72ad0b46ca3e8de2ceadabfaee85cec74cebe226280c40f1dc/fastapi-0.65.0.tar.gz (mirror.py:875) 2022-11-11 11:13:21,477 INFO: Downloading: https://files.pythonhosted.org/packages/4e/b9/a91a699f5c201413b3f61405dbccc29ebe5ad25945230e9cec98fdb2434c/fastapi-0.65.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:21,531 INFO: Downloading: https://files.pythonhosted.org/packages/3a/e5/5eee1f9204886acb45da099f91bf34985b2c536b2746ef9bc3a937751ff7/fastapi-0.65.1.tar.gz (mirror.py:875) 2022-11-11 11:13:23,257 INFO: Downloading: https://files.pythonhosted.org/packages/59/27/c7402c3e9ba3db1a6e7de187ad9de5d9c3b5ee6582fac43267e0c67f8937/fastapi-0.65.3.tar.gz (mirror.py:875) 2022-11-11 11:13:24,842 INFO: Downloading: https://files.pythonhosted.org/packages/63/30/c5c72431045f502d523bdf749ce9afa90ee1591426fcdd3db05f216ca8b7/fastapi-0.66.0.tar.gz (mirror.py:875) 2022-11-11 11:13:26,790 INFO: Downloading: https://files.pythonhosted.org/packages/1b/a0/51ad4a441b28f3c3bfa0b864df4c09c9ba54e67e066f39028130fe3beff7/fastapi-0.66.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:26,845 INFO: Downloading: https://files.pythonhosted.org/packages/f3/84/ca8505d899255f00eb5c8b21817b3a77a946b22c0c469f20b54c03fb47e2/fastapi-0.66.1.tar.gz (mirror.py:875) 2022-11-11 11:13:27,875 INFO: Downloading: https://files.pythonhosted.org/packages/52/be/2a26007dc86c51e87d70021f6c1b3442726c5918fe57d27927badf687122/fastapi-0.67.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:27,910 INFO: Downloading: https://files.pythonhosted.org/packages/49/48/26f1b57a5742b364e33ba2908faf794b024658cf26ac340ae692edd4e677/fastapi-0.67.0.tar.gz (mirror.py:875) 2022-11-11 11:13:29,604 INFO: Downloading: https://files.pythonhosted.org/packages/c1/66/5275b973ab5704e47e6735051f30c1e0c827edec2825b84e77cc21c8ba6c/fastapi-0.68.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:29,667 INFO: Downloading: https://files.pythonhosted.org/packages/64/df/939fed987038be2344d1187b666f7ecf172f81d6c9327357ccce05f4e40f/fastapi-0.68.0.tar.gz (mirror.py:875) 2022-11-11 11:13:31,492 INFO: Downloading: https://files.pythonhosted.org/packages/df/44/ee1976b03404318590bbe4b0ef27007ce2c42b15757aa0c72bc99a4ebae7/fastapi-0.68.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:31,563 INFO: Downloading: https://files.pythonhosted.org/packages/e0/2a/03c3e1ede3aa83c45da1d156b0180288e573f5e2643ec4fd6d697cebebdf/fastapi-0.68.1.tar.gz (mirror.py:875) 2022-11-11 11:13:32,635 INFO: Downloading: https://files.pythonhosted.org/packages/92/a8/10d8a171afa66e6e8a5cfe82771d11c4c84a2a874c19c0b55c7099001fac/fastapi-0.68.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:32,689 INFO: Downloading: https://files.pythonhosted.org/packages/00/6e/4a1dd8aeb5f673f9b772b64a35e7d11e94057306caf3108d52fd47eac7cf/fastapi-0.68.2.tar.gz (mirror.py:875) 2022-11-11 11:13:33,844 INFO: Downloading: https://files.pythonhosted.org/packages/c6/51/7b4d02f3936a4693b871b7b7ae41f19f770c850b54cc5d0b0e98b976e51f/fastapi-0.69.0.tar.gz (mirror.py:875) 2022-11-11 11:13:36,024 INFO: Downloading: https://files.pythonhosted.org/packages/e1/2c/009a8c8b5b3a1d03ee0e65d82d0a0e44c4a937c101fa0397efac12a1f4a3/fastapi-0.7.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:36,102 INFO: Downloading: https://files.pythonhosted.org/packages/39/c8/4021029cc8a20d83048ec4f9aff57061508a00043590b76164fdf983c674/fastapi-0.7.0.tar.gz (mirror.py:875) 2022-11-11 11:13:37,609 INFO: Downloading: https://files.pythonhosted.org/packages/a3/d2/1d27313c69cfb998521a476931266d84b7bd59d479f7ea6bfbe2d94d9964/fastapi-0.7.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:37,621 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/a3/d2/1d27313c69cfb998521a476931266d84b7bd59d479f7ea6bfbe2d94d9964/fastapi-0.7.1-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/a3/d2/1d27313c69cfb998521a476931266d84b7bd59d479f7ea6bfbe2d94d9964' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/a3/d2/1d27313c69cfb998521a476931266d84b7bd59d479f7ea6bfbe2d94d9964' 2022-11-11 11:13:37,625 INFO: Downloading: https://files.pythonhosted.org/packages/5c/9f/0a27b476708aa6c47abefe74a2ef5db14205bd5938d736e7aea9e6ff6bd1/fastapi-0.7.1.tar.gz (mirror.py:875) 2022-11-11 11:13:39,428 INFO: Downloading: https://files.pythonhosted.org/packages/72/44/a35678119f8a6b25f12224bc55463ecc813c4a0a2c3546818890a50db482/fastapi-0.70.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:39,439 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/72/44/a35678119f8a6b25f12224bc55463ecc813c4a0a2c3546818890a50db482/fastapi-0.70.0-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/72/44/a35678119f8a6b25f12224bc55463ecc813c4a0a2c3546818890a50db482' 2022-11-11 11:13:39,442 INFO: Downloading: https://files.pythonhosted.org/packages/e6/35/384bc3bf9a4926a45052037e0bf0806ffeda237b8b731cb04a5e1e1c6a45/fastapi-0.70.0.tar.gz (mirror.py:875) 2022-11-11 11:13:40,621 INFO: Downloading: https://files.pythonhosted.org/packages/90/89/06fe73e915538261626ac4b95b5b8f61938b6150cbed5f9f99c5a16f9719/fastapi-0.70.1.tar.gz (mirror.py:875) 2022-11-11 11:13:42,919 INFO: Downloading: https://files.pythonhosted.org/packages/fe/e9/7bb2bf91b912a6b1fd20e4759742de1b401dad7bf438d9103d3d214f7940/fastapi-0.71.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:42,967 INFO: Downloading: https://files.pythonhosted.org/packages/d7/84/55a906526454816a5d194c8572cb4c4cca8d56f8a1192bf87a9ac101238f/fastapi-0.71.0.tar.gz (mirror.py:875) 2022-11-11 11:13:44,150 INFO: Downloading: https://files.pythonhosted.org/packages/81/da/d3df7f1e153638842a3cf4b1ed0172680d24d6ecd4491ccb8cc132b90778/fastapi-0.72.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:44,188 INFO: Downloading: https://files.pythonhosted.org/packages/af/d8/34d3939d705060c5a0d714db371cf863568c97f88a059489baa442e79c1a/fastapi-0.72.0.tar.gz (mirror.py:875) 2022-11-11 11:13:46,538 INFO: Downloading: https://files.pythonhosted.org/packages/b3/19/f8a27a1c171aef575aec80aecf0bdbc3880f2f2cb3a190b6cc61efd5617e/fastapi-0.73.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:46,577 INFO: Downloading: https://files.pythonhosted.org/packages/27/a7/439a8891b22b4f1e45483b8a3b209f2eabcfdd44e75c339d5f2d315342fa/fastapi-0.73.0.tar.gz (mirror.py:875) 2022-11-11 11:13:48,095 INFO: Downloading: https://files.pythonhosted.org/packages/3f/c1/7c8107f72bcee63f61ce2fe9bb6503a0f67a893c63e063e184f592b9c532/fastapi-0.74.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:48,157 INFO: Downloading: https://files.pythonhosted.org/packages/2a/d4/6a88d73df0b26b6b00378efe6bbde410377f0d3338834e6c7115e86e858a/fastapi-0.74.0.tar.gz (mirror.py:875) 2022-11-11 11:13:50,314 INFO: Downloading: https://files.pythonhosted.org/packages/99/e0/ef1628c4aa96b0a1a2c81a3cac501ebd58849516ea6d1d0e4faf87bf3b34/fastapi-0.74.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:50,365 INFO: Downloading: https://files.pythonhosted.org/packages/c8/ce/07fc3196b05948e16fbc46944728218d4af9a7fb6536e74804c26e303eb8/fastapi-0.74.1.tar.gz (mirror.py:875) 2022-11-11 11:13:51,390 INFO: Downloading: https://files.pythonhosted.org/packages/6d/0b/64ecaddaa9d6d4bbf40422664650f7ec45de9281306c69f22f16f92c510c/fastapi-0.75.0.tar.gz (mirror.py:875) 2022-11-11 11:13:53,092 INFO: Downloading: https://files.pythonhosted.org/packages/cf/63/226c851424ee1a3061e7cff14b9f70e3221b6f33429f8f50e2c98bb30594/fastapi-0.75.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:53,149 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/cf/63/226c851424ee1a3061e7cff14b9f70e3221b6f33429f8f50e2c98bb30594/fastapi-0.75.1-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 911, in download_file self.storage_backend.set_upload_time(path, upload_time) File "/usr/local/lib/python3.10/site-packages/bandersnatch_storage_plugins/filesystem.py", line 288, in set_upload_time os.utime(path, (ts, ts)) PermissionError: [Errno 1] Operation not permitted 2022-11-11 11:13:53,153 INFO: Downloading: https://files.pythonhosted.org/packages/0e/3e/39540da9d0442089c9723c4629657a1d4b17b7fcf260023e3e24c563ce83/fastapi-0.75.1.tar.gz (mirror.py:875) 2022-11-11 11:13:53,189 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/0e/3e/39540da9d0442089c9723c4629657a1d4b17b7fcf260023e3e24c563ce83/fastapi-0.75.1.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/0e/3e/39540da9d0442089c9723c4629657a1d4b17b7fcf260023e3e24c563ce83' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/0e/3e/39540da9d0442089c9723c4629657a1d4b17b7fcf260023e3e24c563ce83' 2022-11-11 11:13:53,194 INFO: Downloading: https://files.pythonhosted.org/packages/a8/68/13f79608112c688a4bc16a4565e1005c362fc61596fad8b962f8fef7cd62/fastapi-0.75.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:53,261 INFO: Downloading: https://files.pythonhosted.org/packages/2c/1c/195178dfef05e6688d9201aca157b5b8a23171dfc685450fba138547d465/fastapi-0.75.2.tar.gz (mirror.py:875) 2022-11-11 11:13:54,680 INFO: Downloading: https://files.pythonhosted.org/packages/d1/94/b7917885697114f5ed4dc2a0839213baefa97256c1516f19d55efceb750e/fastapi-0.76.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:54,749 INFO: Downloading: https://files.pythonhosted.org/packages/7f/6d/9986b5ebbef1872885d9bd76e7ce24def372beddfe5d6e98b5ae36f2e46f/fastapi-0.76.0.tar.gz (mirror.py:875) 2022-11-11 11:13:56,592 INFO: Downloading: https://files.pythonhosted.org/packages/16/3f/6debbab759500c1747d8ecd4c7e6e12891708a9af8e2f89f5cea0a9b9b10/fastapi-0.77.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:56,646 INFO: Downloading: https://files.pythonhosted.org/packages/db/9e/67413d504b1cc044881e7d181c0206a27dd3534fcf6fdf92443477473986/fastapi-0.77.0.tar.gz (mirror.py:875) 2022-11-11 11:13:57,985 INFO: Downloading: https://files.pythonhosted.org/packages/16/5b/d45cca598cec06bead962b84648cbdb0c0d966f2453694bce6f5ce4c0bc9/fastapi-0.77.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:58,036 INFO: Downloading: https://files.pythonhosted.org/packages/eb/ab/bdf0fbdbeb1badc95fd1d6510c575457e53efc23c67021684002200e0aa3/fastapi-0.77.1.tar.gz (mirror.py:875) 2022-11-11 11:13:59,306 INFO: Downloading: https://files.pythonhosted.org/packages/61/0f/427f0af121b226e62237e430f5bf4485e0ae1565b3f5b782613b59f30abc/fastapi-0.78.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:13:59,362 INFO: Downloading: https://files.pythonhosted.org/packages/b7/2a/4676736c3b1864ca483265db43cad9710b83a95c2530aa6bfe671b83fd46/fastapi-0.78.0.tar.gz (mirror.py:875) 2022-11-11 11:14:01,472 INFO: Downloading: https://files.pythonhosted.org/packages/a4/6b/c30654706a6a226e0e640149a893bd75c926097ac4adce6eeb288a133e16/fastapi-0.79.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:01,534 INFO: Downloading: https://files.pythonhosted.org/packages/ae/ed/ea37410618f1c206ba857d391d7b2de6de7a758ea586662aef77c945d3b4/fastapi-0.79.0.tar.gz (mirror.py:875) 2022-11-11 11:14:01,553 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/ae/ed/ea37410618f1c206ba857d391d7b2de6de7a758ea586662aef77c945d3b4/fastapi-0.79.0.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/ae/ed/ea37410618f1c206ba857d391d7b2de6de7a758ea586662aef77c945d3b4' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/ae/ed/ea37410618f1c206ba857d391d7b2de6de7a758ea586662aef77c945d3b4' 2022-11-11 11:14:01,556 INFO: Downloading: https://files.pythonhosted.org/packages/29/95/31db8826daec0bfc9a4bb6ceac3ceeb7e8e6c6b81b6d204aaec788445c8c/fastapi-0.79.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:01,631 INFO: Downloading: https://files.pythonhosted.org/packages/48/eb/feec98de25762193702e909535fbf4a1b3cb63617e6ee2e72c95ae4789ba/fastapi-0.79.1.tar.gz (mirror.py:875) 2022-11-11 11:14:04,058 INFO: Downloading: https://files.pythonhosted.org/packages/4e/86/d44f022e9f339c575bf8d6841d6c683cfa440e752e2197f31297d7bf587b/fastapi-0.8.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:04,124 INFO: Downloading: https://files.pythonhosted.org/packages/4d/58/e91d3dc0b12f26ea73891fd07c5b2d8a3492e732fefe506584e24de9d8e3/fastapi-0.8.0.tar.gz (mirror.py:875) 2022-11-11 11:14:04,835 INFO: Downloading: https://files.pythonhosted.org/packages/32/2c/09a806f0e1b715274c50968cf2c9628abe3cedaa117f23ea94884336d528/fastapi-0.80.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:04,894 INFO: Downloading: https://files.pythonhosted.org/packages/82/93/6bd83151004f2188e016589e4e4f48890087cdf84b3a25212216773258f1/fastapi-0.80.0.tar.gz (mirror.py:875) 2022-11-11 11:14:07,604 INFO: Downloading: https://files.pythonhosted.org/packages/cb/3b/f77f6c450882b23343552d06ad09658d14d535dd6b571fa09b8444cb4628/fastapi-0.81.0.tar.gz (mirror.py:875) 2022-11-11 11:14:10,459 INFO: Downloading: https://files.pythonhosted.org/packages/10/95/33ddb2614d59317a18501ef3f598be0e726f2ce7993feadbdf076a9413a1/fastapi-0.82.0.tar.gz (mirror.py:875) 2022-11-11 11:14:12,056 INFO: Downloading: https://files.pythonhosted.org/packages/bc/34/6746797c8b5275649f99ed57e5a6dd60f912649c0f8ac985b362efd9e8c7/fastapi-0.83.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:12,095 INFO: Downloading: https://files.pythonhosted.org/packages/61/4e/4913c1672374a8161af5e0f865f1a33d8faa185aecaf61b8c288dca1d4fa/fastapi-0.83.0.tar.gz (mirror.py:875) 2022-11-11 11:14:15,004 INFO: Downloading: https://files.pythonhosted.org/packages/60/9a/a41765e60b34af1ba24b7c6dc4d46eb37821cd3a7d616186997b37cb63b2/fastapi-0.84.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:15,056 INFO: Downloading: https://files.pythonhosted.org/packages/6b/1c/e80add75c4c8383d6041a10ca5ee9cdb185ac9d7a8f9ffa94975010e72ca/fastapi-0.84.0.tar.gz (mirror.py:875) 2022-11-11 11:14:18,016 INFO: Downloading: https://files.pythonhosted.org/packages/f8/f6/5334a17a8acb95b2b71825db6c8c3d2b984d1d0c31266fcda02480ab62ab/fastapi-0.85.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:18,054 INFO: Downloading: https://files.pythonhosted.org/packages/f2/74/15805b9921c0fa99a732bbab71fc548a269d027b6540f48043f87338a273/fastapi-0.85.0.tar.gz (mirror.py:875) 2022-11-11 11:14:18,064 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/f2/74/15805b9921c0fa99a732bbab71fc548a269d027b6540f48043f87338a273/fastapi-0.85.0.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/f2/74/15805b9921c0fa99a732bbab71fc548a269d027b6540f48043f87338a273' 2022-11-11 11:14:18,067 INFO: Downloading: https://files.pythonhosted.org/packages/bf/54/6eb1882b5cb29e6647df92ee74d0a93dab149234ec914563cab955fa667f/fastapi-0.85.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:18,152 INFO: Downloading: https://files.pythonhosted.org/packages/76/06/167f461067a95fb631fdf65657089364dc43844bc38d8c39374c3abbc746/fastapi-0.85.1.tar.gz (mirror.py:875) 2022-11-11 11:14:19,986 INFO: Downloading: https://files.pythonhosted.org/packages/99/d4/4256804791b1e822f46bf79015270e9e9f14e9b634cb8231a88f6dc100c3/fastapi-0.85.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:20,043 INFO: Downloading: https://files.pythonhosted.org/packages/f9/7a/8a2cd82257017a4c15f13a8e831bc22c52cc0a3e9fad5a2cc00c491e733f/fastapi-0.85.2.tar.gz (mirror.py:875) 2022-11-11 11:14:22,523 INFO: Downloading: https://files.pythonhosted.org/packages/7b/d6/aa8078112b5bd15b716bb431b25f00e5befc23a05cb3fa66ca4e425b6682/fastapi-0.86.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:22,575 INFO: Downloading: https://files.pythonhosted.org/packages/3d/c4/0cbe3b1213cdb4b3dd8692ed30788b01bf49d88d71afcb1c296a608f6029/fastapi-0.86.0.tar.gz (mirror.py:875) 2022-11-11 11:14:24,337 INFO: Downloading: https://files.pythonhosted.org/packages/cf/fe/1b987eb94099504630e3c3dcb324e803466f1afd96ff33cb1ae7b2652cc4/fastapi-0.9.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:24,396 INFO: Downloading: https://files.pythonhosted.org/packages/d7/2b/08583e9aeaacde54a1bc814a29916e390ebd36f7d54d53e9ef5b3236d21c/fastapi-0.9.0.tar.gz (mirror.py:875) 2022-11-11 11:14:25,088 INFO: Downloading: https://files.pythonhosted.org/packages/f4/0e/17e5aba8ee34c2175689b1064d84b4050d2a530afdf8ca13c186a47e6b1a/fastapi-0.9.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:25,155 INFO: Downloading: https://files.pythonhosted.org/packages/98/c7/5c98837ca82d4e49c16891100724328931bd07b79e61528291bbf94436bb/fastapi-0.9.1.tar.gz (mirror.py:875) 2022-11-11 11:14:26,730 ERROR: Error syncing package: fastapi@15646760 (mirror.py:377) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 130, in package_syncer await self.process_package(package) File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 337, in process_package await self.sync_release_files(package) File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 693, in sync_release_files raise deferred_exception # raise the exception after trying all files File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/b7/48/6a691a87c3eb8638e2e6adb8e1a0e34d35067122a63db29e8c2b435ff3e0' 2022-11-11 11:14:26,731 INFO: Fetching metadata for package: typer (serial 15668790) (package.py:58) 2022-11-11 11:14:26,801 INFO: Downloading: https://files.pythonhosted.org/packages/86/3b/a6ae58ce89ef9e0d65089ecc184d8e5a77080c0f1fc1037585935412fa19/typer-0.0.1-py2.py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:26,811 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/86/3b/a6ae58ce89ef9e0d65089ecc184d8e5a77080c0f1fc1037585935412fa19/typer-0.0.1-py2.py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/86/3b/a6ae58ce89ef9e0d65089ecc184d8e5a77080c0f1fc1037585935412fa19' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/86/3b/a6ae58ce89ef9e0d65089ecc184d8e5a77080c0f1fc1037585935412fa19' 2022-11-11 11:14:26,815 INFO: Downloading: https://files.pythonhosted.org/packages/a0/81/ea81e189cec05a1fada5782020f09a2347fd8f8502041faae2def4e5af74/typer-0.0.1.tar.gz (mirror.py:875) 2022-11-11 11:14:26,860 INFO: Downloading: https://files.pythonhosted.org/packages/41/cc/a4f55b00caea08b5539d5ef9aea645133dd0e0643127b95846a3ee966e8f/typer-0.0.10-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:26,898 INFO: Downloading: https://files.pythonhosted.org/packages/36/1c/5b17f76feafc67549576c3f622eeac6fd9945a53d1564854229fb4f0c9d4/typer-0.0.10.tar.gz (mirror.py:875) 2022-11-11 11:14:26,978 INFO: Downloading: https://files.pythonhosted.org/packages/72/ac/e172237b8385cc3d4ca6bb6afab6b5426360f74810e3663bd1c816f967a0/typer-0.0.11-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,020 INFO: Downloading: https://files.pythonhosted.org/packages/e7/36/ff4d070cdee878c99eabd145e47dd144d6fb9468451df5126d325d50ba16/typer-0.0.11.tar.gz (mirror.py:875) 2022-11-11 11:14:27,032 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/e7/36/ff4d070cdee878c99eabd145e47dd144d6fb9468451df5126d325d50ba16/typer-0.0.11.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/e7/36/ff4d070cdee878c99eabd145e47dd144d6fb9468451df5126d325d50ba16' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/e7/36/ff4d070cdee878c99eabd145e47dd144d6fb9468451df5126d325d50ba16' 2022-11-11 11:14:27,036 INFO: Downloading: https://files.pythonhosted.org/packages/fa/75/01183d8ae6a8a938640422e206bf1d59dc5500f961ca09728b12665a0eb8/typer-0.0.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,085 INFO: Downloading: https://files.pythonhosted.org/packages/91/61/258be64afc783ea61788b463b1a67461bedfe2cb9d8e1d2aa2725643c57a/typer-0.0.2.tar.gz (mirror.py:875) 2022-11-11 11:14:27,140 INFO: Downloading: https://files.pythonhosted.org/packages/53/f9/a7ec5d901bafc9aab85b217b7a3790058d014f2adb58247cba2cb323702f/typer-0.0.3-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,190 INFO: Downloading: https://files.pythonhosted.org/packages/29/8a/422b3712a5b25c7fd5d0b0b16bab36a7475dc6d774defb4a374d02ab9e01/typer-0.0.3.tar.gz (mirror.py:875) 2022-11-11 11:14:27,255 INFO: Downloading: https://files.pythonhosted.org/packages/fe/60/5a41ee557055b476baa1676c3c10cdf2e6b4e53b367e64e8c599134fe898/typer-0.0.4.tar.gz (mirror.py:875) 2022-11-11 11:14:27,315 INFO: Downloading: https://files.pythonhosted.org/packages/ee/d7/1000db0e30ec5f709e0fcc696ea665c2853c250a76636d86e7699924bab5/typer-0.0.5-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,346 INFO: Downloading: https://files.pythonhosted.org/packages/ad/ac/8e2c82f550dd85c882e3e9bd58af8d3a0ee634b6aecd7fb9b379dab506b8/typer-0.0.5.tar.gz (mirror.py:875) 2022-11-11 11:14:27,405 INFO: Downloading: https://files.pythonhosted.org/packages/a3/2e/91ee4ee24c673391c54fb87ecb5e82cc0e1c5bfa4f379df9009fdf99635a/typer-0.0.6-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,416 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/a3/2e/91ee4ee24c673391c54fb87ecb5e82cc0e1c5bfa4f379df9009fdf99635a/typer-0.0.6-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/a3/2e/91ee4ee24c673391c54fb87ecb5e82cc0e1c5bfa4f379df9009fdf99635a' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/a3/2e/91ee4ee24c673391c54fb87ecb5e82cc0e1c5bfa4f379df9009fdf99635a' 2022-11-11 11:14:27,420 INFO: Downloading: https://files.pythonhosted.org/packages/f5/6e/7219854685d84ddfa16d4ea6976d31548f211e6156e7f473f2ca5f6ed23d/typer-0.0.6.tar.gz (mirror.py:875) 2022-11-11 11:14:27,500 INFO: Downloading: https://files.pythonhosted.org/packages/c4/29/bcab289c7813970b466823394cea42a727fc490fff91ca5153512034dc74/typer-0.0.7-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,545 INFO: Downloading: https://files.pythonhosted.org/packages/91/9c/3e1efefede3dc00eab2a5de2972aeb8500064f3d80f3f5c0ee051ad05bff/typer-0.0.7.tar.gz (mirror.py:875) 2022-11-11 11:14:27,599 INFO: Downloading: https://files.pythonhosted.org/packages/3d/0d/5cae34b35c490068bdf434a046705fafec6eb6142f7b80a2d1044ad9005c/typer-0.0.8-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,634 INFO: Downloading: https://files.pythonhosted.org/packages/4f/80/6e2b5596d97ba8f65a32bb281219c34e1d1bb1b024e836bf3e792b45d069/typer-0.0.8.tar.gz (mirror.py:875) 2022-11-11 11:14:27,694 INFO: Downloading: https://files.pythonhosted.org/packages/23/0f/869db91f69918b1fee8f0047b5d4e6805ca33da1bdcee9cbfc8ae2917660/typer-0.0.9-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,743 INFO: Downloading: https://files.pythonhosted.org/packages/7e/ed/63a34302863799c00d2b0655eb212a211d1da1999f9894e494dee2dc0d26/typer-0.0.9.tar.gz (mirror.py:875) 2022-11-11 11:14:27,821 INFO: Downloading: https://files.pythonhosted.org/packages/48/d6/80fe583ce3a2fad3a105efedc9ecfefbd840df7ebc732ff77bf4b71be1f7/typer-0.1.0.tar.gz (mirror.py:875) 2022-11-11 11:14:27,880 INFO: Downloading: https://files.pythonhosted.org/packages/ba/66/6b47a43821a6cefea52429d71ccc8210967d93e14950bc84a79f0c1106b3/typer-0.1.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:27,928 INFO: Downloading: https://files.pythonhosted.org/packages/f1/ef/5f76002a54d0afdf02aa0b8e5612e2783445bb60290816a1a410319d7862/typer-0.1.1.tar.gz (mirror.py:875) 2022-11-11 11:14:27,988 INFO: Downloading: https://files.pythonhosted.org/packages/8a/2a/854041a9347250e1a4ebdbb5becc9861ad9ce6efd958dd387da0f500c9b2/typer-0.2.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:28,027 INFO: Downloading: https://files.pythonhosted.org/packages/55/53/cecdc86563621d85c23f72b828301f37217ffd84fc65f3c7ee9960b78d4f/typer-0.2.0.tar.gz (mirror.py:875) 2022-11-11 11:14:28,091 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/55/53/cecdc86563621d85c23f72b828301f37217ffd84fc65f3c7ee9960b78d4f/typer-0.2.0.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 911, in download_file self.storage_backend.set_upload_time(path, upload_time) File "/usr/local/lib/python3.10/site-packages/bandersnatch_storage_plugins/filesystem.py", line 288, in set_upload_time os.utime(path, (ts, ts)) PermissionError: [Errno 1] Operation not permitted 2022-11-11 11:14:28,095 INFO: Downloading: https://files.pythonhosted.org/packages/7d/01/23ad684b9b54bd84530113695e97fca75b597b22a7254843b9a4a2cc6ac2/typer-0.2.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:28,107 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/7d/01/23ad684b9b54bd84530113695e97fca75b597b22a7254843b9a4a2cc6ac2/typer-0.2.1-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/7d/01/23ad684b9b54bd84530113695e97fca75b597b22a7254843b9a4a2cc6ac2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/7d/01/23ad684b9b54bd84530113695e97fca75b597b22a7254843b9a4a2cc6ac2' 2022-11-11 11:14:28,110 INFO: Downloading: https://files.pythonhosted.org/packages/c9/56/5c2bd55e362d796f41c96531da08563e8911ecb0aecf2567dcd7af38c4a4/typer-0.2.1.tar.gz (mirror.py:875) 2022-11-11 11:14:28,188 INFO: Downloading: https://files.pythonhosted.org/packages/20/82/d8e6c9100f31b7cffb7274603d41e77af1c70ea2d9f03671313ec7868454/typer-0.3.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:28,236 INFO: Downloading: https://files.pythonhosted.org/packages/7c/6a/d36d186029c95059de231fc7f0b5d0fc044955c10af2248cd30aec84a7d0/typer-0.3.0.tar.gz (mirror.py:875) 2022-11-11 11:14:28,312 INFO: Downloading: https://files.pythonhosted.org/packages/73/5d/94781aa6849c98bf71e9389efc7112ecc171fe544b55ceab8583228d039d/typer-0.3.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:28,362 INFO: Downloading: https://files.pythonhosted.org/packages/40/e4/ce127a97e198ed5d4b032cc78d65c8143fe97adbc80da888d50da8923c34/typer-0.3.1.tar.gz (mirror.py:875) 2022-11-11 11:14:28,431 INFO: Downloading: https://files.pythonhosted.org/packages/90/34/d138832f6945432c638f32137e6c79a3b682f06a63c488dcfaca6b166c64/typer-0.3.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:28,442 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/90/34/d138832f6945432c638f32137e6c79a3b682f06a63c488dcfaca6b166c64/typer-0.3.2-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/90/34/d138832f6945432c638f32137e6c79a3b682f06a63c488dcfaca6b166c64' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/90/34/d138832f6945432c638f32137e6c79a3b682f06a63c488dcfaca6b166c64' 2022-11-11 11:14:28,446 INFO: Downloading: https://files.pythonhosted.org/packages/d5/74/40abdad73bc8b5b17a5a6e442fc57b20f5cc2ee869632625083762490de6/typer-0.3.2.tar.gz (mirror.py:875) 2022-11-11 11:14:28,518 INFO: Downloading: https://files.pythonhosted.org/packages/4f/bd/77f6cb38c291717c5109cc2638086033fd7de4f8aeb0ed95e9ed484efa82/typer-0.4.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:28,568 INFO: Downloading: https://files.pythonhosted.org/packages/41/50/2f5ec9e22ae5298bc8bc5ae9009bc3fe150a5110e81243a7e0b841f06bae/typer-0.4.0.tar.gz (mirror.py:875) 2022-11-11 11:14:28,651 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/41/50/2f5ec9e22ae5298bc8bc5ae9009bc3fe150a5110e81243a7e0b841f06bae/typer-0.4.0.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 911, in download_file self.storage_backend.set_upload_time(path, upload_time) File "/usr/local/lib/python3.10/site-packages/bandersnatch_storage_plugins/filesystem.py", line 288, in set_upload_time os.utime(path, (ts, ts)) PermissionError: [Errno 1] Operation not permitted 2022-11-11 11:14:28,656 INFO: Downloading: https://files.pythonhosted.org/packages/52/bb/2bf41b92ea42ed36874669afad18ffe1c5b95d96d2f26dacfa33edb22b79/typer-0.4.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:28,672 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/52/bb/2bf41b92ea42ed36874669afad18ffe1c5b95d96d2f26dacfa33edb22b79/typer-0.4.1-py3-none-any.whl (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/52/bb/2bf41b92ea42ed36874669afad18ffe1c5b95d96d2f26dacfa33edb22b79' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/52/bb/2bf41b92ea42ed36874669afad18ffe1c5b95d96d2f26dacfa33edb22b79' 2022-11-11 11:14:28,675 INFO: Downloading: https://files.pythonhosted.org/packages/84/f2/71a04c8aa8718570d6f7570f6871fd358c29c715035f63630dadbd460da8/typer-0.4.1.tar.gz (mirror.py:875) 2022-11-11 11:14:28,759 INFO: Downloading: https://files.pythonhosted.org/packages/9d/ea/b565bc44a1af5278ef2ff9d571cdb4f4bc31fd450b0630441c93401c243c/typer-0.4.2-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:28,806 INFO: Downloading: https://files.pythonhosted.org/packages/fb/9e/8ae5ef480622282fc98507c0226e95de0accdf5e98ab7f57a5c8ba054339/typer-0.4.2.tar.gz (mirror.py:875) 2022-11-11 11:14:29,388 INFO: Downloading: https://files.pythonhosted.org/packages/81/3b/5f09648e180279eefe964c6792c40525840e0e21ad57f8fef1a2c3ddddf7/typer-0.5.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:29,439 INFO: Downloading: https://files.pythonhosted.org/packages/38/01/1d26c2cccef5bf4c5b23b77423e5feb0402c2f6d474fa20bf831d07df524/typer-0.5.0.tar.gz (mirror.py:875) 2022-11-11 11:14:29,506 INFO: Downloading: https://files.pythonhosted.org/packages/43/ca/da2ef672f4930d9f0bdc05310cf3e270db1b27d63c6aa666c99b3fc99e02/typer-0.6.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:29,543 INFO: Downloading: https://files.pythonhosted.org/packages/62/19/bf22fc686e985ba2d878a4c62b84734549b446324575e4efbab0f086f8f5/typer-0.6.0.tar.gz (mirror.py:875) 2022-11-11 11:14:29,552 ERROR: Continuing to next file after error downloading: https://files.pythonhosted.org/packages/62/19/bf22fc686e985ba2d878a4c62b84734549b446324575e4efbab0f086f8f5/typer-0.6.0.tar.gz (mirror.py:686) Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/62/19/bf22fc686e985ba2d878a4c62b84734549b446324575e4efbab0f086f8f5' 2022-11-11 11:14:29,555 INFO: Downloading: https://files.pythonhosted.org/packages/e8/9b/7470461c68588ed09c2e53cbb16b802815232796d95f7b4744cc8842f19d/typer-0.6.1-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:29,608 INFO: Downloading: https://files.pythonhosted.org/packages/cf/f9/27c5cd9ab067e3ece4cecb920c33f38cc986f839b12de19650fd49dc3c63/typer-0.6.1.tar.gz (mirror.py:875) 2022-11-11 11:14:29,690 INFO: Downloading: https://files.pythonhosted.org/packages/0d/44/56c3f48d2bb83d76f5c970aef8e2c3ebd6a832f09e3621c5395371fe6999/typer-0.7.0-py3-none-any.whl (mirror.py:875) 2022-11-11 11:14:29,739 INFO: Downloading: https://files.pythonhosted.org/packages/e1/45/bcbc581f87c8d8f2a56b513eb994d07ea4546322818d95dc6a3caf2c928b/typer-0.7.0.tar.gz (mirror.py:875) 2022-11-11 11:14:29,825 ERROR: Error syncing package: typer@15668790 (mirror.py:377) Traceback (most recent call last): File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileNotFoundError: [Errno 2] No such file or directory: '/srv/pypi/web/packages/86/3b/a6ae58ce89ef9e0d65089ecc184d8e5a77080c0f1fc1037585935412fa19' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 130, in package_syncer await self.process_package(package) File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 337, in process_package await self.sync_release_files(package) File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 693, in sync_release_files raise deferred_exception # raise the exception after trying all files File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 662, in sync_release_files downloaded_file = await self.download_file( File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 879, in download_file dirname.mkdir(parents=True) File "/usr/local/lib/python3.10/pathlib.py", line 1180, in mkdir self.mkdir(mode, parents=False, exist_ok=exist_ok) File "/usr/local/lib/python3.10/pathlib.py", line 1175, in mkdir self._accessor.mkdir(self, mode) FileExistsError: [Errno 17] File exists: '/srv/pypi/web/packages/86/3b/a6ae58ce89ef9e0d65089ecc184d8e5a77080c0f1fc1037585935412fa19' 2022-11-11 11:14:29,827 INFO: Generating global index page. (simple.py:223) 2022-11-11 11:14:29,977 INFO: 1 packages had changes (mirror.py:990) 2022-11-11 11:14:29,977 INFO: Writing diff file to mirrored-files (mirror.py:1000) ```
cooperlees commented 2 years ago

Rightio - so not a race and/or filelock not working. Will have to find some time to look into it. All help welcome as I'm short on time to dedicate to bandersnatch these days.

tibeer commented 2 years ago

Tested it again. This time with one worker but an increased timeout. Instead of 10 I opted for 30 and now it works. I turned down the timeout again, turns out it still works. My guess currently is that there is an issue with pypi.org itself and not my setup. Though I also tried a different machine (Linux) in a cloud and found this:

2022-11-15 13:59:07,282 ERROR: Call to list_packages_with_serial @ https://pypi.org/pypi timed out: Connection timeout to host https://pypi.org/pypi (master.py:218)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/main.py", line 231, in <module>
    exit(main())
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/main.py", line 227, in main
    return asyncio.run(async_main(args, config))
  File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/main.py", line 192, in async_main
    return await bandersnatch.mirror.mirror(config)
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 986, in mirror
    changed_packages = await mirror.synchronize(
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 65, in synchronize
    await self.determine_packages_to_sync()
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/mirror.py", line 297, in determine_packages_to_sync
    all_packages = await self.master.all_packages()
  File "/usr/local/lib/python3.10/site-packages/bandersnatch/master.py", line 223, in all_packages
    raise XmlRpcError("Unable to get full list of packages")
bandersnatch.master.XmlRpcError: Unable to get full list of packages

May these problems occur if pypi itself is not "properly" reachable?

cooperlees commented 2 years ago

Interesting. What kind of internet connection do you have and where are you in the world?

The xmlrpc PyPI API is an old rate limited beast of an API. It's heavy on resource on the PyPI backend. Also, due to lots of CI from clouds hitting the API, you can sometimes be rate limited. It does get overloaded. It's known, I've been trying for years to drop bandersnatch's use of it, but there is still no more efficient replacement for these API calls.

tibeer commented 1 year ago

I'm based in Germany using a fibre connection. The two datacenters I used for double-checking are based in Cologne and somewhere else (I don't know the location). The reason I want to setup the mirror is exactly that: Ditch the issues of rate limits. Now comes the really fun part: I tried installing bandersnatch directly via pip without the docker containers. Now it works flawlessly without any errors.

I verified this by running plainly this:

docker run -v '/home/ubuntu/bandersnatch/conf:/conf' pypa/bandersnatch:latest

which works perfectly fine. Again testing with my docker-compose:

version: '3'
services:
  bandersnatch:
    image: pypa/bandersnatch:latest
    volumes:
      - "/home/ubuntu/bandersnatch/conf:/conf"
      - "./data:/srv/pypi/web"
  bandersnatch_nginx:
    image: mynginx
    build: ./nginx
    volumes:
      - "./data:/data/pypi/web:ro"
    ports:
      - "40080:80"

Issues persist. Next try without mounting the data directory:

version: '3'
services:
  bandersnatch:
    image: pypa/bandersnatch:latest
    volumes:
      - "/home/ubuntu/bandersnatch/conf:/conf"
  bandersnatch_nginx:
    image: mynginx
    build: ./nginx
    volumes:
      - "./data:/data/pypi/web:ro"
    ports:
      - "40080:80"

Same issue. Next try single container:

version: '3'
services:
  bandersnatch:
    image: pypa/bandersnatch:latest
    volumes:
      - "/home/ubuntu/bandersnatch/conf:/conf"

Still the same issue. Realising that docker-compose creates a seperate network each time you spint up the compose. Further testing confirms if I use the host network:

version: '3'
services:
  bandersnatch:
    image: pypa/bandersnatch:latest
    network_mode: "host"
    volumes:
      - "/home/ubuntu/bandersnatch/conf:/conf"

Everything works again perfectly fine. Seems there is some strange behaviour when it comes to the container and docker networks in bridge mode. I have literally no idea why this is the case. And being able to reproduce this different clouds / environments / locations I assume there might be a misunderstanding from my side how bandersnatch handles network traffic. Do you have an idea what might cause this behaviour?

tibeer commented 1 year ago

Got it! It was indeed the MTU. I thought setting the MTU in the docker daemon would help me avoid issues with the MTU. Turns out it does not. Fix that might help others:

version: '3'
services:
  bandersnatch:
    image: pypa/bandersnatch:latest
    volumes:
      - "/home/ubuntu/bandersnatch/conf:/conf"
      - "/home/ubuntu/bandersnatch/data:/srv/pypi/web"
    networks:
      - bandersnatch_net
  bandersnatch_nginx:
    image: mynginx
    build: ./nginx
    volumes:
      - "/home/ubuntu/bandersnatch/data:/data/pypi/web:ro"
    ports:
      - "40080:80"
    networks:
      - bandersnatch_net

networks:
  bandersnatch_net:
    driver: bridge
    driver_opts:
      com.docker.network.driver.mtu: 800
cooperlees commented 1 year ago

The main parts of PyPI that get ratelimited, bandersnatch does not (and can't) mirror (xml rpc). But you do get the Simple API and JSON API mirrored.

Seems there is some strange behaviour when it comes to the container and docker networks in bridge mode. I have literally no idea why this is the case. And being able to reproduce this different clouds / environments / locations I assume there might be a misunderstanding from my side how bandersnatch handles network traffic. Do you have an idea what might cause this behaviour?

I'm kinda a networking guy, I have not seen this before with docker networking. I even run speedtest (https://github.com/cooperlees/speedtest) from my home docker networks to check my ISP performance a few times a day + log to prometheus (I route to my docker containers so I can dual stack them with unique IPs so I know what container is making what connections). Maybe you could try run that with 1500 MTU and 800 MTU and see how it goes. iperf in a container could also help here ...

IPv6 (if icmpv6 is not blocked) should also do path MTU discovery by default and just handle any non 1500 byte capable links along your path. Do you have firewalls blocking ICMPv6 in your infra? Have you turned Path MTU off for IPv6 on linux (via sysctls)?

tibeer commented 1 year ago

800 was the value i took "just to be sure". Most of the clouds I work on use OpenStack on the bottom and depending on the setup, their overlay network just handles an MTU of 1500 which in result causes every package on the VM to get packed again and therefore 1500 is too high. Though, the VMs can figure out the MTU by themself while docker can not (at least that's what i've read from various issues in the docker repo). Since the clouds exclusively use IPv6 (bummer) I cannot test that. But I realised that the original issue using MacOS, docker overlayfs, etc. is still there. Otherwise I would have been able to test from home with IPv6. On the other Hand I do not have hard MTU limits at home. I just closed the issue as I assume the issue resolved for me. The containers will run on Linux in production any way.