search

neume-network / extraction-worker

Async worker_thread component for maximalizing concurrent data retrieval and processing.
GNU General Public License v3.0
3 stars 5 forks source link

some blatantly wrong IPFS CIDs aren't immediately purged from the worker #33

Closed TimDaub closed 2 years ago

TimDaub commented 2 years ago

e.g. here this CID uses a minus char in its name: "https://github.com/neume-network/data/runs/7186772889?check_suite_focus=true#step:7:55731"

We should integrate an IPFS CID validator before making requests

TimDaub commented 2 years ago

see: