erangell / Articles

Markdown source for articles
MIT License
4 stars 0 forks source link

EDL structure and implications for performance #4

Open erangell opened 2 years ago

erangell commented 2 years ago

Various forms of EDLs have appeared over the years. If we define it as a list of tumblers, where each tumbler locates a span of content, then it can be a JSON file with an array of tumblers. Indexing within the target file/blob would be a range of bytes. We will want to take advantage of sparse querying provided by hypercore/hyperdrive structures. So maybe hypercores can be used for blobs and textual documents can be stored in hyperdrives. Need to think through various use cases.