search

huggingface / optimum-tpu

Google TPU optimizations for transformers models
Apache License 2.0
76 stars 19 forks source link

Handle selector exception #73

Closed tengomucho closed 4 months ago

tengomucho commented 4 months ago

What does this PR do?

This handles very unlikely to happen exceptions and return empty prefill responses instead of crashing.