cloudkernels / vaccel

A meta repo for gathering all the necessary components for running (and releasing) a vaccel environment
10 stars 2 forks source link

Plugin design & implementation of vAccel inference operation supporting TensorFlow #21

Closed bchalios closed 2 years ago

bchalios commented 3 years ago

Design and implement a back-end plugin that implements the vAccel inference operation #20, that supports TensorFlow models.

This plugin will be built on top of the TensorFlow C++ API. It will consume a model that has been previously registered with the session #19, and it will receive in some input data and a buffer in which to place output results.

Internally the plugin will need to transform the input data in TensorFlow tensor data types and pass them to the appropriate TensorFlow function calls.