Closed TKONIY closed 1 month ago
The prefill_and_generate returns List[Tensor], which cannot be fed into tokenizer.decode. e.g., [Tensor[1], Tensor[2]]
prefill_and_generate
List[Tensor]
tokenizer.decode
[Tensor[1], Tensor[2]]
Make it returns List[int], e.g., [1, 2]
List[int]
[1, 2]
Bug Report
The
prefill_and_generatereturnsList[Tensor], which cannot be fed intotokenizer.decode. e.g.,[Tensor[1], Tensor[2]]Fix
Make it returns
List[int], e.g.,[1, 2]