Research groups would like to use Solid for research data repositories. The resources they make available for download can be binary or RDF data and have sizes in the ranges of 100 GB - TBs. It should be possible to download parts of data resources and download resources over slow networks. Currently:
Solid protocols support range requests (but it is not mandatory to implement)
CSS currently doesn't support HTTP range requests over non-rdf and rdf resources
CSS has a default timeout of 3 seconds when sending data to clients. Clients that have been downloading data over slow minutes for many minutes get disconnected when the timeout conditions are hit.
Desired solution
Support HTTP Range requests for rdf and non-rdf resources in their native serialisation format (at least)
Support an increasing timeout limits for clients that have been downloading data for some time
Acceptance criteria
Add a non-rdf of at least 500 GB on a CSS server and download the last 100 bytes
Simulate a slow/noisy network and download the 500 GB
RubenVerborgh
commented
2 years ago
Pitch
Research groups would like to use Solid for research data repositories. The resources they make available for download can be binary or RDF data and have sizes in the ranges of 100 GB - TBs. It should be possible to download parts of data resources and download resources over slow networks. Currently:
Desired solution
Acceptance criteria
Pointers
https://solidproject.org/TR/protocol#http-server
Scenarios