apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.88k stars 4.27k forks source link

RunInference V1 #21435

Open damccorm opened 2 years ago

damccorm commented 2 years ago

Users of machine learning frameworks must currently implement their own transforms for running ML inferences. The exception is the TensorFlow RunInference transform. However, this is hosted in its own repo, and has an API that is exclusively geared towards the TensorFlow TFX library. Our goal is to add new implementations of RunInference for the two other popular machine learning frameworks: scikit-learn and Pytorch.

Please see main design document here.

Imported from Jira BEAM-13970. Original Jira may contain additional context. Reported by: yeandy.

damccorm commented 2 years ago

The following subtask(s) are associated with this issue: #21436, #21437, #21438, #21439, #21440, #21441, #21442, #21443, #21444, #21445, #21446, #21447, #21448, #21449, #21450, #21451, #21452, #21453, #21454