OpenMined / SyferText

A privacy preserving NLP framework
Apache License 2.0
198 stars 49 forks source link

Fixed pipeline parsing and implemented SubPipeline reuse #178

Closed AlanAboudib closed 4 years ago

AlanAboudib commented 4 years ago

Description

Pipeline parsing into subpipelines was not functional when pipe components had different permissions. This is fixed now.

Also, when a pipeline is parsed for multiple data owners, this could result in identical subpipelines among different data owner, in order to reduce redundancy, I implemented subpipeline reuse.

How has this been tested?

I hadn't implemented unit tests yet. Merging this PR is urgent for #pricon2020

Checklist

Nilanshrajput commented 4 years ago

Oh already merged, will check on this changes on the next pr