Finish voyager payments

space-meridian / roadmap

High-level roadmap for Filecoin Station

https://starmap.site/roadmap/github.com/space-meridian/roadmap/issues/1

0 stars 0 forks source link

Finish voyager payments #94

Closed juliangruber closed 1 week ago

juliangruber commented 5 months ago

[x] Receive payment from funding source
[x] Download Voyager measurements from W3C
[x] Evaluate measurements
[x] Figure out what to do about balances <0.1 FIL
[x] Send funds to smart contract
[x] Set scores in smart contract
[x] https://github.com/filecoin-station/site-backend/pull/15
[x] https://github.com/filecoin-station/desktop/pull/1824
[x] Announce rewards

juliangruber commented 4 months ago

Now that we have all Voyager measurements in W3C, we can write a script to download them, evaluate and reward.

juliangruber commented 2 months ago

Still exporting Voyager measurements, currently at 3.7TB

juliangruber commented 2 months ago

Still exporting Voyager measurements, currently at 16TB

juliangruber commented 2 months ago

After 17TB, the export crashed with EFBIG. I will remove one disk from the RAID array and resume writing measurements to it.

The process should be resumed from cursor value bafybeiayhmo4rttwwbstzdbmrf47rcmoxmuk7z2ms6wi7omg5ccjghtlda. There will be some duplicate measurements between the end of the current export and the beginning of the new one.

juliangruber commented 2 months ago

I have removed /dev/sdc3 from the raid array, reformatted and mounted it:

$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev             32G     0   32G   0% /dev
tmpfs           6.3G  796K  6.3G   1% /run
/dev/md2         20T   17T  2.8T  86% /
tmpfs            32G     0   32G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
/dev/md1        989M   66M  873M   7% /boot
tmpfs           6.3G     0  6.3G   0% /run/user/0
/dev/sdc3        20T  3.6G   19T   1% /root/download-measurements/export/2

The old export is in export/1/voyager.txt, the resumed export is being written to export/2/voyager.txt.

juliangruber commented 1 month ago

It crashed again after writing another 17TB. The total export size at the moment is 34TB.

The process should be resumed from cursor value bafybeifwycojnl2ffj64o4lv55hwfwitoq5oln4kxxnprdwsb6jwdftode. There will be some duplicate measurements between the end of the current export and the beginning of the new one.

juliangruber commented 1 month ago

The hetzner server became unreachable. I fear this means I will have to reboot it, at which point the tmux session with the output of the last cursor value will have been lost :|

juliangruber commented 1 month ago

Worst case we will resume from the cursor 2 weeks ago, and delete the last export

juliangruber commented 1 month ago

Finish this issue by iterating over the participants table

juliangruber commented 2 weeks ago

1359.54 FIL have been paid to 4333 participants 🥳