Together with isamosss I've created an example notebook that showcases how to compile and deploy a pretrained CLIP model from HuggingFace Transformers, using the AWS Deep Learning Containers. We use AWS Deep Learning Containers as they offer a convenient, pre-configured environment with necessary deep learning framework and AWS Neuron dependencies.
In this notebook an example is shown how to use a ml.trn1 instance to compile the model before deploying it, making this example runnable in SageMaker Studio.
Together with isamosss I've created an example notebook that showcases how to compile and deploy a pretrained CLIP model from HuggingFace Transformers, using the AWS Deep Learning Containers. We use AWS Deep Learning Containers as they offer a convenient, pre-configured environment with necessary deep learning framework and AWS Neuron dependencies.
In this notebook an example is shown how to use a
ml.trn1instance to compile the model before deploying it, making this example runnable in SageMaker Studio.