itamarst / eliot

Eliot: the logging system that tells you *why* it happened
https://eliot.readthedocs.io
Apache License 2.0
1.1k stars 66 forks source link

Document/handle large numpy arrays in JSON serializer #410

Closed itamarst closed 5 years ago

itamarst commented 5 years ago

A numpy array with 10M entries isn't rare, but shouldn't be serialized to JSON.

  1. By default only log a sample.
  2. Document other ways of handling it (writing to large file, omitting array completely).