vivarium-collective / vivarium-core

Core Interface and Engine for Vivarium
https://vivarium-core.readthedocs.io/
Apache License 2.0
26 stars 3 forks source link

Breakdown fixes #222

Closed thalassemia closed 2 years ago

thalassemia commented 2 years ago

This PR contains two fixes pertaining to the automatic breakdown of emits larger than MongoDB's 16 MB document limit. First, the default internal limit for the breakdown_data function is lowered to 4 MB. This guarantees that the broken-down data will be smaller than 16 MB even in the worst case scenario where data is dominated by single-digit integers. Secondly, broken-down documents are now guaranteed to have the experiment_id field and show up in queries for that ID.


By creating this pull request, I agree to the Contributor License Agreement, which is available in CLA.md at the top level of this repository.