search

vietai / ViT5

MIT License
59 stars 9 forks source link

Couldn't reproduce the result from huggingfaces hosted API #7

Open ithieund opened 1 year ago

ithieund commented 1 year ago

Hello @justinphan3110 , I followed the snippet from this link to reproduce the summarization result: https://huggingface.co/VietAI/vit5-large-vietnews-summarization

First, it can generate the summarised text but that text has some problems

image
  1. The first token seems to be wrong or has kind of vocabulary error
  2. The entire text seems to be a failure as the text is so long and does not relevant to the main text
  3. That generated text is not the same as the generated result from huggingfaces hosted API
image

Could you explain that effect and how to get exactly the same result as hosted API? Thank you.