TrustedDataGraph / HackFS2023DataVerification

DataVerification and Reputation System
MIT License
1 stars 1 forks source link

Retrieve data with Lotus node. #10

Open kozayupapa opened 1 year ago

kozayupapa commented 1 year ago

retrieve success case

referring data from https://datasets.filecoin.io/terra-fusion-data-sampler?page=293

bafybeihx7yyv5cyjbv37doig2zop4ayq776wzcbumgjwkptewm7hqgzsou P26 23900013343 lotus client ls --miner f03223 0.21s user 0.05s system 2% cpu 12.359 total


* retrieve soon actual data Recv start.
```shell
% lotus client retrieve --miner f03223 bafybeielt6cevxh4v32oscimbpcevd6f2smilq56oj64wwn55aif57cmnm TFDS-main-16837 
Recv 0 B, Paid 0 FIL, Open (New), 1ms [1686490144655012015|0]
Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 43ms [1686490144655012015|0]
Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 291ms [1686490144655012015|0]
Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 292ms [1686490144655012015|0]
Recv 55 B, Paid 0 FIL, BlocksReceived (Ongoing), 355ms [1686490144655012015|55]
Recv 467 B, Paid 0 FIL, BlocksReceived (Ongoing), 355ms [1686490144655012015|467]
Recv 7.678 KiB, Paid 0 FIL, BlocksReceived (Ongoing), 420ms [1686490144655012015|7862]
Recv 16.18 KiB, Paid 0 FIL, BlocksReceived (Ongoing), 495ms [1686490144655012015|16572]
Recv 272.2 KiB, Paid 0 FIL, BlocksReceived (Ongoing), 1.057s [1686490144655012015|278716]
Recv 528.2 KiB, Paid 0 FIL, BlocksReceived (Ongoing), 1.445s [1686490144655012015|540860]

retrieve error case

referring data from https://datasets.filecoin.io/folding-at-home-covid?page=990

lotus client ls --miner f01707292 0.42s user 0.14s system 0% cpu 2:16.79 total


* retrieve error or long long wait.
```shell
(base) lassie % lotus client retrieve --from f16i6hqgydlkv4hrdctianggjh6y2rtlsw6tlpoxi --maxPrice 10 --miner f01707292 bafykbzacebxzao5pp25qngroekbaw2osq2wq7yp7smxv7v37a32oqlpfzsjvi bdc-sentinel-2_264.tar                        

Recv 0 B, Paid 0 FIL, Open (New), 0s [1686490144655012012|0]
Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 22ms [1686490144655012012|0]
Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 238ms [1686490144655012012|0]
Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 244ms [1686490144655012012|0]
Recv 0 B, Paid 0 FIL, DataTransferError (Erroring), 2m9.534s [1686490144655012012|0]
Recv 0 B, Paid 0 FIL, BlockstoreFinalized (Errored), 2m9.546s [1686490144655012012|0]
ERROR: Retrieval Error: error generated by data transfer: deal data transfer failed: data transfer channel 12D3KooWMVyDZgnVdcWK15obWgSLi8KRiTwQdHJRWyUhzYJ6YPrk-12D3KooWG3DGD3tK9G8eqrD9MtaRMw8EJ1cQdhhwztHbkkFeWfRA-1686490144652294012 failed to transfer data: channel 12D3KooWMVyDZgnVdcWK15obWgSLi8KRiTwQdHJRWyUhzYJ6YPrk-12D3KooWG3DGD3tK9G8eqrD9MtaRMw8EJ1cQdhhwztHbkkFeWfRA-1686490144652294012: graphsync request failed to complete: request failed - content not found

(base) lassie % lotus client  retrieve --miner f01759249 bafybeidnclt22ucoolmf5ovf55doukzbkvnbmpl5zzoqzci422cmp7wne4 janelia-flylight-imagery_441.tarbackups_9 
Recv 0 B, Paid 0 FIL, Open (New), 6ms [1686490144655012013|0]
Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 20ms [1686490144655012013|0]
Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 217ms [1686490144655012013|0]
Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 221ms [1686490144655012013|0]

long time waiting,  and no DL happens.

payment channel

I tried with payment channel , but it has no relation with errors.

create channel

(base) lassie % lotus paych add-funds f16i6hqgydlkv4hrdctianggjh6y2rtlsw6tlpoxi f01707292 10
waiting for confirmation..
f273zihespoyldecbzfsexsurkjr2pkjcapfccgsi

create voucher

(base) lassie % lotus paych voucher create f273zihespoyldecbzfsexsurkjr2pkjcapfccgsi 2
i1UC_vKDkk92FjIIOSyJeVIqTHT1JEAAAED2AAFJABvBbWdOyAAAAIBYQgHlcDSVcpt7TqXw5J24hKrYGxMvGi8xnHGhkgr8olCJb3d5Tn2CqP8YApnIB0sBW6JsiTO0Sj1t9xCO0Fl_W-j_AA
(base) lassie % 

send to sp

(base) lassie % lotus paych voucher add f273zihespoyldecbzfsexsurkjr2pkjcapfccgsi  $VOUCHER