search

pytorch / benchmark

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
BSD 3-Clause "New" or "Revised" License
871 stars 285 forks source link

Speech_transformer issue #2023

Closed Aswin-coder closed 11 months ago

Aswin-coder commented 1 year ago

I am trying to run the speech transformer model, but if I run it is displaying as "No hypothesis, Finish decoding"

  1. Is there any way to fix it?
  2. Can I pass my own wav audio file as input and predict it?
Aswin-coder commented 1 year ago

@davidberard98 can you help me please?

davidberard98 commented 1 year ago

can you provide more details about how to reproduce the issue

Aswin-coder commented 1 year ago

can you provide more details about how to reproduce the issue

  1. I cloned the repo
  2. python install.py model=speech transformer
  3. python run.py speech transformer -d cpu -t eval
davidberard98 commented 1 year ago

are you missing the underscore in the commands?

  1. python install.py speech_transformer
  2. python run.py speech_transformer -d cpu -t eval
Aswin-coder commented 1 year ago

are you missing the underscore in the commands?

  1. python install.py speech_transformer
  2. python run.py speech_transformer -d cpu -t eval

Thats not an issue, model working fine but prediction is not working

Screenshot 2023-11-01 180338
xuzhao9 commented 1 year ago

@Aswin-coder The goal of TorchBench core models is to run fast a single batch with one iteration test for performance testing, it does not run end-2-end model, therefore it can't produce e2e metrics such as prediction.

Therefore, you can't pass your own wav audio file and predict it.