Hi, I was able to run llama for a single forward, but when I tried to make it generate texts in an autoregressive way, there were errors with input shapes. Looks like a fixed sized input is set when exporting the model (correct me if I'm wrong). I would like to know if LLM text generation is currently supported. Thanks.
Hi, I was able to run llama for a single forward, but when I tried to make it generate texts in an autoregressive way, there were errors with input shapes. Looks like a fixed sized input is set when exporting the model (correct me if I'm wrong). I would like to know if LLM text generation is currently supported. Thanks.