amazon-ion / ion-c

A C implementation of Amazon Ion.
https://amazon-ion.github.io/ion-docs/
Apache License 2.0
166 stars 43 forks source link

Support reading large values dynamically #322

Open tgregg opened 1 year ago

tgregg commented 1 year ago

ion-c's reader includes configurable limits on value sizes. See _ion_reader_options.symbol_threshold and _ion_reader_options.user_value_threshold. The configured values result in fixed-size internal buffers that are incapable of handling Ion values that exceed the configured limits if such values occur while reading a stream. This is unsuitable in for use cases that are not aware of, or do not control, the size of values that may be encountered.