fsspec / ipfsspec

readonly python fsspec implementation for IPFS
MIT License
21 stars 10 forks source link

use aiohttp-retry to try again on specific request errors #36

Closed d70-t closed 1 month ago

d70-t commented 1 month ago

Sometimes, especially when requesting many objects at once, timeouts occur, which (again sometimes) lead to data corruption when using glob or zarr. This PR adds automatic retry in those cases, and should fix the problem with a high likelyhood.