Blacksmoke16 / oq

A performant, and portable jq wrapper to facilitate the consumption and output of formats other than JSON; using jq filters to transform the data.
https://blacksmoke16.github.io/oq/
MIT License
190 stars 15 forks source link

[RFC] New YAML format #68

Closed Blacksmoke16 closed 3 years ago

Blacksmoke16 commented 3 years ago

Instead of #27 (or until a solution is figured out), another solution could be to introduce a new dedicated format that could be streamed. Say syaml (Simple YAML). Alternatively, this could be made the default and require a dedicated type if your YAML uses anchors/aliases depending on which is more common. This would allow YAML to be streamed when possible, saving on quite a bit of memory when processing large files/input.

This would also be pretty easy to implement as the code existed previously, ref https://github.com/Blacksmoke16/oq/pull/18/files#diff-6158ec3689d157ae13cf40562e63c4c70449f425ade22682a1183b93c1ee3a84R10-R55.