SEMICeu / LinkedDataEventStreams

The Linked Data Event Streams specification
https://tree.linkeddatafragments.org/linked-data-event-streams/
23 stars 9 forks source link

Status indication of a derived View #5

Open pietercolpaert opened 3 years ago

pietercolpaert commented 3 years ago

Status indication

When replicating a stream on your own system when, for example, building other tree:views on top of them with different fragmentations, you MAY track the progress of how much elements from the original stream are processed into your own system.

This should become possible using an ldes:elementsProcessed as follows:

<Collection> a ldes:EventStream ;
    hydra:totalItems 500 ;
    tree:view :View1 .
:View1 a tree:Node ;
    ldes:elementsProcessed 250 .
julianrojas87 commented 3 years ago

Given the immutable nature of a LDES it could end up with multiple predicates ldes:elementsProcessed 250, ldes:elementsProcessed 325, ... right?

Since it is transient metadata, perhaps consider adding it as part of a X-LDES-ElementsProcessed HTTP header for example?

In this way a client can just do a HEAD request to verify if a projection is already fully processed.