search

rpcpool / yellowstone-faithful

Project Yellowstone Old Faithful is the project to make all of Solana's history accessible, content addressable and available via a variety of means.
https://old-faithful.net/
GNU Affero General Public License v3.0
75 stars 16 forks source link

Create a function to read and sort a list of urls of car splits / validate car file splits #169

Open linuskendall opened 1 week ago

linuskendall commented 1 week ago
  1. HEAD request to get size
  2. Read header
  3. Figure out CID for subset
  4. Read a chunk at the end to load the subset

This will give us:

This can also be done when loading split car files from the file system so we can validate that we have every slot in the epoch.

anjor commented 1 week ago

@linuskendall just to confirm this is basically a url version of https://github.com/rpcpool/yellowstone-faithful/pull/166 right?

linuskendall commented 1 week ago

Yep!

On Thu, Oct 10, 2024 at 6:25 PM Anjor Kanekar @.***> wrote:

@linuskendall https://github.com/linuskendall just to confirm this is basically a url version of #166 https://github.com/rpcpool/yellowstone-faithful/pull/166 right?

— Reply to this email directly, view it on GitHub https://github.com/rpcpool/yellowstone-faithful/issues/169#issuecomment-2405012803, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABHOYRNX3IG3QB2QGVJF76DZ2Z2LXAVCNFSM6AAAAABPUKMY3SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMBVGAYTEOBQGM . You are receiving this because you were mentioned.Message ID: @.***>