data-preservation-programs / spade

A Fil-Network Storage-Proposal Management Service
Other
8 stars 1 forks source link

Retrieval Bot - Integration to add HTTP Piece retrieval tests for Spade #37

Closed jcace closed 7 months ago

jcace commented 11 months ago

Description:

We won't be running the Fil+ integration for the Spade RB, but we still need to tell it to do Piece HTTP retrieval testing.

https://github.com/data-preservation-programs/RetrievalBot/blob/main/integration/spadev0/util.go#L132C1-L132C28

Modify the spade integration, adding a separate (random) http retrieval test for a piece CID in the dataset.

Note that these HTTP retrieval tests must target the Replica.PieceCID, not the Replica.OptionalDagRoot as in the Bitswap tests.

Ensure we set the retrieve_size of the retrieval task too so that it doesn't attempt to retrieve the entire thing.

ETA: YYY-MM-DD Maintainer:

### Milestones
- [ ] <add here>

Known dependencies:

View this starmap at: