NIM on GCP Vertex AI Python

NVIDIA / nim-deploy

A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.

https://build.nvidia.com/

Apache License 2.0

141 stars 64 forks source link

Closed FortunaZhang closed 3 months ago

FortunaZhang commented 3 months ago

To support GCP account, run and deploy NIM on GCP Vertex AI with Python notebook

liveaverage commented 3 months ago

This looks great and thank you again @FortunaZhang ... per our conversation we might want to rework some of the top-level README:

sample requests should be fully functional copy/paste shell or python snippets vs. pseudo-code
we should emphasize inference requests must be routed to :rawPredict

@supertetelman could we also get your review on this?

FortunaZhang commented 3 months ago

@liveaverage Thanks for the advice. I updated the README addressing these two issues, please check latest commit: https://github.com/NVIDIA/nim-deploy/pull/58/commits/9da7cf6f454ab2dd52a75e7a716688de444c4345

supertetelman commented 3 months ago

Closing after merging other PR, as discussed.