Not able to convert OpenAI hugging face TF Whisper model to int8 model - Githubissues

google-ai-edge / ai-edge-torch

Supporting PyTorch models with the Google AI Edge TFLite runtime.

Apache License 2.0

378 stars 51 forks source link

Not able to convert OpenAI hugging face TF Whisper model to int8 model #394

Open pkgoogle opened 4 days ago

pkgoogle commented 4 days ago

Description of the bug:

Original Issue: https://github.com/tensorflow/tensorflow/issues/58451 Opening on behalf of @nyadla-sys

1. System information

Linux Ubuntu 16.04:

2. Code

Provide code to help us reproduce your issues using one of the following options:

Option A: Reference colab notebooks

Reference [TensorFlow Lite Model Colab]

Option B: Paste your code here or provide a link to a custom end-to-end colab

https://colab.research.google.com/drive/1rApSDy3KMoMMaK3SIQwvu21yPas2VFjx?usp=sharing

3. Failure after conversion

Model produces correct results with hybrid model.
Colab session is getting crashed with int8 model

Actual vs expected behavior:

No response

Any other information you'd like to share?

No response

gaikwadrahul8 commented 3 days ago

This issue originally reported by @nyadla-sys has been moved to this dedicated repository for ai-edge-torch to enhance issue tracking and prioritization. To ensure continuity, we have created this new issue on your behalf.

We appreciate your understanding and look forward to your continued involvement.