google / generative-ai-docs

Documentation for Google's Gen AI site - including the Gemini API and Gemma
https://ai.google.dev
Apache License 2.0
1.46k stars 494 forks source link

Optimizing PaliGemma to TFLite / TorchScript #470

Open DarioPTWR opened 1 week ago

DarioPTWR commented 1 week ago

Description of the feature request:

Hi, I was wondering if anyone has a conversion script or method that can be used to convert PaliGemma from HuggingFace Transformers to TFLite or TorchScript? Am trying to use it in mobile devices but currently can't seem to find a method that works 100% for this model conversion. Any help is greatly appreciated, thanks!

What problem are you trying to solve with this feature?

No response

Any other information you'd like to share?

No response