search

opengeospatial / ogcapi-environmental-data-retrieval

A Web API that provides a family of lightweight interfaces for accessing Environmental Data resources.
https://ogcapi.ogc.org/edr
Other
59 stars 26 forks source link

JSON encoding for timeseries that enables streaming responses. #343

Open dblodgett-usgs opened 2 years ago

dblodgett-usgs commented 2 years ago

The current recommended encodings do not lend themselves to streaming -- we should seek out a streamable encoding for timeseries. Could flesh this out much more, just leaving as a note for the future.

tomkralidis commented 2 years ago

Related: https://datatracker.ietf.org/doc/html/rfc7464

dblodgett-usgs commented 2 years ago

Yes. Indeed. I'd be curious to see how you would work with metadata surrounding a stream like that. Looks like it's really designed for logging.

lvdbrink commented 2 years ago

Just a tip, without knowing if it might be useful: CityJSON 1.1 does streaming, you might check out their solution of streaming with cityjsonfeature. They use JSON lines text streams. I don't know its relationship to rfc7464.

chris-little commented 2 years ago

This is a good idea, but there are a lot of issues around streaming JSON, and whether it is applcable to any or all EDR queries. Needs to be linked to Pub/Sub requireement, and perhaps a different service endpoint may be appropriate. Tagged as V1.3 at the earliest.

ghobona commented 2 years ago

The adjective "streamable" might be problematic because there is a company called Streamable that has its own JSON encoding and API.

This was pointed out in the Vector Tiles Pilot a few years ago.