How to accelerate fine tune model with TPU using happy transformer?

EricFillion / happy-transformer

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.

http://happytransformer.com

Apache License 2.0

516 stars 66 forks source link

Open imrankh46 opened 1 year ago

imrankh46 commented 1 year ago

Hi, I'm trying to accelerate fine tune a model for a specific task using happy transformer. Can someone show how to do this !

EricFillion commented 1 year ago

Try saving the model and then load it into whatever platform you want to use for acceleration.

imrankh46 commented 1 year ago

Im talking about to fine tune for downstream task or other data set.

EricFillion commented 1 year ago

Thanks for the clarification. I thought you were referring to using something like Hugging Face's Optimum library.

Happy Transformer currently doesn't support using a TPU for training