search

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.7k stars 4.2k forks source link

Add resource location hints to base RunInference Implementation #21448

Open damccorm opened 2 years ago

damccorm commented 2 years ago

Our generic version of RunInference should add resource location hints, similar to what TFX-BSL does here.

 

https://github.com/tensorflow/tfx-bsl/blob/182918aaefd5287e7669d87bfc818155470315aa/tfx_bsl/beam/run_inference.py#L117

 

There's no reason that these hints shouldn't be just as relevant to sk-learn or pytorch large models hosted on GC or wherever these hints are supported.

Imported from Jira BEAM-14218. Original Jira may contain additional context. Reported by: Ryan.Thompson. Subtask of issue #21435

damccorm commented 2 years ago

Unable to assign user @ryanthompson591. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.