The model zoo:llama2-7b-open_platypus_orca_llama2_pretrain-pruned40_quantized does not have the sequence length set internally in the onnx model (@alexm-nm is that something that we expect in the first place)? Because we cannot deduce this parameter, we are crashing with a very obscure message. This PR adds more verbose termination, that guides the user towards the right action (providing the sequence length manually)
Fix for: https://app.asana.com/0/1206109050183159/1206490681470513/f
The model
zoo:llama2-7b-open_platypus_orca_llama2_pretrain-pruned40_quantizeddoes not have the sequence length set internally in the onnx model (@alexm-nm is that something that we expect in the first place)? Because we cannot deduce this parameter, we are crashing with a very obscure message. This PR adds more verbose termination, that guides the user towards the right action (providing the sequence length manually)