search

redhat-et / ray-on-the-edge-demo

A proof of concept for machine learning workflows using the Ray stack in the data center and at the edge.
Apache License 2.0
0 stars 2 forks source link

add serving notebook #12

Closed MichaelClifford closed 2 years ago

MichaelClifford commented 2 years ago

This PR partially addresses issue #11 and adds a Ray Serve Notebook to the repo. It also includes some changes to how the model is saved in the Pet_Classifier notebook to make model serving a bit simpler.

One outstanding issue to take care of in a future PR, this implementation uses CPU for inference and does not take advantage of the available GPU's. GPU usage was causing issues on the cluster and needs to be investigated further.

review-notebook-app[bot] commented 2 years ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB