red-hat-data-services / odh-deployer

The odh-deployer image creates a custom resource for the image in operator image in odh-operator-allinone
Apache License 2.0
5 stars 42 forks source link

Remove tensorflow from the supported runtimes in OOTB Serving Runtimes #363

Closed lucferbux closed 1 year ago

lucferbux commented 1 year ago

Description

Based on the outcome of https://issues.redhat.com/browse/RHODS-8874 it seems that ovms is not supporting tensorflow as previously suggested.

Removing the runtime selection for the OOTB models.

How Has This Been Tested?

  1. Deploy the runtimes with oc apply -k odh-dashboard/modelserving
  2. Deploy a new model
  3. Select OOTB Serving Runtime
  4. Check that the Serving Runtime doesn't include tensorflow

@lugi0 I haven't tested the upgrade, I'll try to do it on Monday, I'm working in other things.

Merge criteria:

openshift-ci[bot] commented 1 year ago

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please ask for approval from lucferbux. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files: - **[OWNERS](https://github.com/red-hat-data-services/odh-deployer/blob/main/OWNERS)** Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
Xaenalt commented 1 year ago

We did eventually find the model that was working with TF support, https://storage.googleapis.com/download.tensorflow.org/models/tflite/model_zoo/upload_20180427/inception_resnet_v2_2018_04_27.tgz

That being said, it does seem compatibility for TF is very narrow, maybe we should list it as tech preview or something in the UI instead

lucferbux commented 1 year ago

I'm gonna close this PR then, we don't have the ability to mark runtimes with labels, but it should be a good idea, I'm gonna ask Jeff if that's something we might wanna be interested in.