As a CF pipelines user, I would like to understand the memory consumption when pipelines are executed. Given pipelines accept nparrays, will zero copy sharing of Ray help?
Acceptance Criteria
[ ] Memory growth as pipelines are executed
[ ] Clear documentation on this
[ ] A potential story explaining this in more detail
Overview
As a CF pipelines user, I would like to understand the memory consumption when pipelines are executed. Given pipelines accept nparrays, will zero copy sharing of Ray help?
Acceptance Criteria
Questions
Assumptions
Reference