search

ipfs-search / ipfs-search

Search engine for the Interplanetary Filesystem.
http://ipfs-search.com
GNU Affero General Public License v3.0
844 stars 108 forks source link

Redis/cache connection doesn't seem to reopen #245

Open dokterbob opened 1 year ago

dokterbob commented 1 year ago 
Dec 17 17:48:37 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmRYNAwxEcTcvYDfTFJZKtUpSQzUgAqToJvgTEnUnLz8mb', result: cache error in writing &{} to QmRYNAwxEcTcvYDfTFJZKtUpSQzUgAqToJvgTEnUnLz8mb: closed
Dec 17 17:48:38 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmUSYH8tGs2BJyDLu5onzCUVifU7Z494q9UDQKsqKDp1iJ', result: cache error in get: closed
Dec 17 17:48:38 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmYGg6bWicD9Nv4DatNC2FTCmnAwJETxw3HWFurasEt6Vd', result: cache error in get: closed
Dec 17 17:48:38 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmWdUXc5RTwHtvUNEyWWN83hZ4vuJqsJkBNsPfUTCeL481', result: cache error in get: closed
Dec 17 17:48:38 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmcG2FwNVDgdQvuC39yxXMYQu9Jo7bpPtv41P2GiugvDro', result: cache error in get: closed
Dec 17 17:48:38 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmUVz8YExPa7jEGzGFA1Td2cGFpoUbJ4bbZp3NQB7WrJSp', result: cache error in get: closed
Dec 17 17:48:38 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://Qma1dRW9TcaYs449kk5ZkKtxhGg1qXgrqE3iZdgt7AKxbj', result: cache error in get: closed
Dec 17 17:48:40 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmRhHwSsi9FugvcnMEGf3raxmh4KRmRiTqd5WSYyno4GMB', result: cache error in get: closed
Dec 17 17:48:46 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmPCuNbMSXDSUzSG6Tv6mh5uybzip1XmhrhpCxrSf5WdZd', result: cache error in get: closed
Dec 17 17:48:46 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmfSWx63yHEpXkpe1jTxG865rhBVvrnSQfZPBhsqApKEqk', result: cache error in get: closed
Dec 17 17:48:46 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmVjjJ6qcgnEZrC52meAfE7bTFo2Yqg8DHW63oERYLi4NH', result: cache error in get: closed
Dec 17 17:48:46 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmRkMBpB1XYfP3FjQ4eCVvupgMjF7pN1iFf4Wv7NZyR2Wf', result: cache error in get: closed
Dec 17 17:48:46 lovelace ipfs-crawler[627487]: Done crawling 'ipfs://QmQ1XXS62ziSxTD1DGfWg5fojULjYiJ8zPt6nxZ11H2Bf9', result: cache error in get: closed
dokterbob commented 1 year ago

This might be due to context closeds.

Workaround: don't fail operations on ErrCache. Risk; backing store gets out of sync with cache.

dokterbob commented 1 year ago

Might have been fixed by Refactor Conn completely, remove discard list, improve tests

dokterbob commented 1 year ago

Or here https://github.com/mediocregopher/radix/pull/323 in 4.1.1