search

huggingface / Google-Cloud-Containers

Hugging Face Deep Learning Containers (DLCs) for Google Cloud
https://hf.co/docs/google-cloud
Apache License 2.0
127 stars 16 forks source link

Add notebook for finetuning golden-gate #6

Closed shub-kris closed 9 months ago

shub-kris commented 9 months ago

This PR adds an example notebook that finetunes 2B Golden-Gate model using peft, trl, bitsandbytes (4 bit quantization), transformers on timdettmers/openassistant-guanaco dataset.

shub-kris commented 9 months ago

Looks good, but how can i use it on vertex ai?

I have added very brief info on how one can use the notebook on a Google Compute Engine and on a Vertex AI Workbench instance.

These are the only two ways I know on how can use a notebook with Google Compute Engine and Vertex AI. Shall I describe them in more detail?

philschmid commented 9 months ago

Looks good, but how can i use it on vertex ai?

I have added very brief info on how one can use the notebook on a Google Compute Engine and on a Vertex AI Workbench instance.

These are the only two ways I know on how can use a notebook with Google Compute Engine and Vertex AI. Shall I describe them in more detail?

Not an expert here but can you use any docker container in Vertex AI Workbench? We cloud add cli commands on how create the workbench and maybe clone the repository with the example?

shub-kris commented 9 months ago

Looks good, but how can i use it on vertex ai?

I have added very brief info on how one can use the notebook on a Google Compute Engine and on a Vertex AI Workbench instance. These are the only two ways I know on how can use a notebook with Google Compute Engine and Vertex AI. Shall I describe them in more detail?

Not an expert here but can you use any docker container in Vertex AI Workbench? We cloud add cli commands on how create the workbench and maybe clone the repository with the example?

Yes, we could add cli commands on how to create workbench and demonstrate an example.

Regarding docker container: as far as I know, I think one can only use the container that are in Google Container and Artifact Registry and the ones that Google provides by default.

Here it says the same: https://cloud.google.com/vertex-ai/docs/general/deep-learning